-- Logs begin at Mon 2022-07-18 07:51:17 UTC, end at Mon 2022-07-18 09:05:44 UTC. -- Jul 18 08:36:25.597397 dv-cinder-850142-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 08:36:25.609528 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 08:36:25 2022] *** Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: nodename: dv-cinder-850142-3-iscsi Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: machine: x86_64 Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: clock source: unix Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: pcre jit disabled Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: detected number of CPU cores: 4 Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: current working directory: / Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: detected binary path: /usr/bin/uwsgi-core Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: your processes number limit is 47680 Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: your memory page size is 4096 bytes Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: detected max file descriptor number: 2048 Jul 18 08:36:25.611975 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: lock engine: pthread robust mutexes Jul 18 08:36:25.613748 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: thunder lock: enabled Jul 18 08:36:25.613748 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 08:36:25.613748 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 08:36:25.654354 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: Python main interpreter initialized at 0x5574a10f69c0 Jul 18 08:36:25.654354 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: python threads support enabled Jul 18 08:36:25.654354 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: your server socket listen backlog is limited to 100 connections Jul 18 08:36:25.654354 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: your mercy for graceful operations on workers is 90 seconds Jul 18 08:36:25.654789 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 08:36:25.654789 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: *** Operational MODE: preforking *** Jul 18 08:36:25.655085 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: *** uWSGI is running in multiple interpreter mode *** Jul 18 08:36:25.655085 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: spawned uWSGI master process (pid: 110300) Jul 18 08:36:25.655301 dv-cinder-850142-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 08:36:25.656182 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: spawned uWSGI worker 1 (pid: 110301, cores: 1) Jul 18 08:36:25.656292 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: spawned uWSGI worker 2 (pid: 110302, cores: 1) Jul 18 08:36:25.656608 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 08:36:26.339435 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 08:36:26.341383 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 08:36:27.453238 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:36:27.453238 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: from cryptography.utils import int_from_bytes Jul 18 08:36:27.454041 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:36:27.454041 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: from cryptography.utils import int_from_bytes Jul 18 08:36:27.454649 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:36:27.454649 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: from cryptography.utils import int_from_bytes Jul 18 08:36:27.455332 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:36:27.455332 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: from cryptography.utils import int_from_bytes Jul 18 08:36:30.083932 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 08:36:30.084500 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 08:36:30.084893 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 08:36:30.085338 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 08:36:30.085658 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 08:36:30.085756 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 08:36:30.086105 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 08:36:30.086182 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.086441 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.086541 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 08:36:30.086853 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.086956 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 08:36:30.087137 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 08:36:30.087237 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.087531 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.087643 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.087938 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.088120 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.088209 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.088522 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.088620 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.088855 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.088991 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.089167 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.089437 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.089539 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.089767 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.089863 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.090092 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.090184 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.090368 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.090464 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850142-3-iscsi {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.090724 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.090823 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.091123 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850142-3-iscsi {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.091221 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.091333 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.091421 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.091654 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.091771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.091980 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.092067 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.092304 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.092396 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.092617 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.092715 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.092944 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.093835 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.094054 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.094354 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.094669 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.095161 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.095596 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.095776 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.095973 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.096229 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.096334 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.096439 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.096721 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.096869 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.096971 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.097213 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.097361 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.097549 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.097690 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.097894 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.098026 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.098252 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850142-3-iscsi {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.098453 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.099003 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.099259 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.099537 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.099806 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.100120 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.100361 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850142-3-iscsi {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.100654 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.100951 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.101328 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.101328 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.101929 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.102130 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.102281 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.102472 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.102628 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.102906 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.103044 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.103178 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.103178 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.103449 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.103584 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.103742 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.103871 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.103871 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.104163 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.104297 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.104297 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.104547 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.104679 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.104810 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.104940 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.104940 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.105191 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.105376 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.105376 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.105632 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.105764 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.105969 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.106113 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.106305 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.106468 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.106602 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.106800 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.106936 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.107122 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.107308 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.107470 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.112949 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.113150 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.113302 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.113440 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.113583 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.113712 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.113837 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.113967 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.114103 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.114229 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.114352 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.114474 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.114596 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.114731 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.114731 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.114986 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.114986 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.115227 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.115362 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.115500 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.115633 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.115794 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.115937 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.116074 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.116232 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.116374 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.116499 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.116632 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.116756 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.116888 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.117025 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.117163 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.117287 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.117420 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.117550 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.117674 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.117674 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.117930 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.118054 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.118054 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.118054 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.118404 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.118535 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.118535 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.118535 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.118885 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.119008 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.119130 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.119261 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.119261 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.119506 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.119630 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.119630 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.119916 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.120051 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.120051 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.120290 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.120412 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.120412 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.120672 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.120804 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.120927 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.121051 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.121051 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.121294 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.121499 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.121499 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.121747 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.121872 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.121872 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.122102 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.122233 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.122233 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.122469 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.122593 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.122593 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.122835 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.122984 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.123197 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.123327 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.123327 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.123566 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.123765 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.123765 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.124035 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.124162 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.124162 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.124404 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.124562 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.124703 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.124835 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.124835 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.125072 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.125201 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.125338 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.125582 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.125710 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.125889 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.126021 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.126211 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.126423 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.126557 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.126809 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.126946 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.127128 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.127319 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.127455 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.127764 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.127916 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.128071 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.128260 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.128392 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.128672 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.128807 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.128979 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.129148 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.129281 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.129575 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.129703 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.129878 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.130076 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.130219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.130473 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.130612 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.130779 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.131058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.131195 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.131453 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.131617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.131814 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.132015 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.132149 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.132380 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.132513 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.132724 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.132917 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.133051 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.133383 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.133534 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.133721 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.133854 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.134038 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.134232 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.134362 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.134650 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.134784 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.134992 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.135125 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.135281 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.135531 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.135699 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.135931 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.136069 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.136252 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.136482 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.136610 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.136887 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.137034 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.137255 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.137395 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.137525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.137784 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.137917 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.138132 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.138270 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.138450 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.138731 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.138867 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.139079 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.139203 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.139385 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.139543 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.139750 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.140021 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.140721 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.140995 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.141311 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.141439 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.141642 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.141850 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.141980 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.142261 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.142388 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.142576 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.142754 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.142904 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.143202 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.143359 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.143565 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.143724 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.143872 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.144109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.144287 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.144486 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.144613 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.144801 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.144970 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.145121 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.145407 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.145620 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.145753 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.145876 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.146049 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.146286 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.146438 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.146952 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.147241 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.147396 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.147563 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.147781 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.147931 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.148029 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.148112 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.148190 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.148190 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.148525 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.148627 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.148809 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.148900 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.149090 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.149291 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:36:30.149383 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.149701 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.149797 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.150032 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.150219 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.150383 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.150655 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.150851 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.150989 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.151157 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.151258 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.151563 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.151725 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.152002 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.152179 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.152306 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.152494 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.152595 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.152801 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.152955 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.153140 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.153401 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.153497 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.153724 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.153853 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.154033 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.154214 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.154339 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.154653 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.154878 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.154987 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.155263 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.155360 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.155574 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.155711 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.156501 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.156705 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.156910 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.157021 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.157129 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.157281 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.157451 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.157600 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.157770 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.157914 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.158067 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.158223 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.158400 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.158546 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.158740 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.158881 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.159048 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.159708 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.159708 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.159888 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.159966 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.160034 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.160184 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.160318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.160502 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.160827 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.161085 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.161207 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.161446 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.161666 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.161762 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.161982 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.162090 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.162420 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.162530 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.162626 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.162707 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.162897 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.162996 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.163201 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.163374 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.163528 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.163724 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.163862 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.164005 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.164143 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.164291 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.164484 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.165018 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.165168 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.165397 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.165610 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.165805 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.166007 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.166179 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.167583 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.167855 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.168043 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.168195 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.168337 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.168470 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.168601 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.168731 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.168863 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.169110 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.169110 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.169508 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.169741 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.169923 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.170408 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.170580 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.170795 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.170994 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.171163 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.171379 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.171561 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.172090 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.172308 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.172696 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.172869 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.173056 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.173225 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.173387 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.173710 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.173906 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.174102 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.174278 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.174478 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.174642 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.175129 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.175344 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.175549 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.175747 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.176062 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.176062 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.176547 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.176746 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.177146 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.177327 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.177516 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.177680 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.178180 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.178390 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.178603 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.178784 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.178973 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.179134 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.179782 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.179887 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.179970 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180050 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180126 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180194 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180260 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180332 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180399 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180479 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180553 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180620 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180686 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180751 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180824 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180899 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.180966 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181031 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181031 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181149 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181149 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181350 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181425 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181498 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181498 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181624 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181624 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181755 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181821 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181885 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.181955 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.182021 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.182021 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.182166 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.182231 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.182304 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.182370 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.182452 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.182520 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.182603 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.183276 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.183430 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.183569 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.183747 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.183892 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.184117 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.184270 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.184419 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.184566 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.184712 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.184872 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.185037 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.185220 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.185383 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.185855 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.186178 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.186345 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.186505 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.186643 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.186808 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.187304 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.187546 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.187728 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.187872 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.188014 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.188196 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.188355 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.188520 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.188691 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.188832 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.188968 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.189110 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.189281 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.189451 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.189591 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.189726 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.189882 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.190029 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.190191 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.190335 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.190493 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.190633 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.190791 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.190954 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.191125 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.191267 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.191411 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.191553 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.191729 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.191880 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.192016 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.192161 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.192304 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.192439 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.192574 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.192721 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.193054 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.193054 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.193352 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.193488 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.193630 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.193775 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.193911 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.194060 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.194319 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.194505 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.194646 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.194794 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.194937 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.195111 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.195260 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.195404 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.195554 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.195762 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.195904 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.196040 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.196192 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.196357 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.196507 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.196643 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.196778 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.196947 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.197087 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.197222 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.197365 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.197543 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.197693 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.197829 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.197968 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.198141 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.198291 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.198427 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.198562 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.198742 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.198891 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.199036 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.199215 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.199356 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.199491 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.199627 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.199783 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.199935 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.200102 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.200242 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.200242 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.200504 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.200641 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.200793 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.200951 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.201120 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.201266 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.201402 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.201537 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.201680 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.201827 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.201968 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.202110 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.202246 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.202389 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.202555 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.203499 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.203742 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.204006 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.204170 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.204440 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.204588 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.204734 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.204884 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.205021 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.205021 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.205322 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.205497 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.205639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.205639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.205900 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.205900 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.206149 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.206289 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.206422 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.206561 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.206715 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.206848 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.206981 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.207121 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.207254 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.207254 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.207509 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.207641 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.207809 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.208020 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.208157 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.208290 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.208423 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.208572 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.208712 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.208845 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.208985 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.208985 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.209236 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.209368 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.209508 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.209647 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.209786 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.209918 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.210050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.210193 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.210333 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.210613 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.210745 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.210884 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.211016 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.211157 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.211288 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.211420 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.211550 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.211714 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.211855 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.211999 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.212138 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.212271 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.212403 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.212534 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.212673 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.212807 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.212938 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.213069 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.213218 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.213395 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.213531 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.213616 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.213695 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.213772 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.213866 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.213946 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.214037 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.214118 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.214203 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.214283 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.214368 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.214480 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.214614 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.214698 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.214776 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.214853 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.214937 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215023 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215103 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215180 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215180 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215329 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215406 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215496 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215576 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215653 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215792 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215875 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.215952 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216043 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216130 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216216 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216295 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216372 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216462 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216619 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216703 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216790 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216878 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.216957 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217043 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217123 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217200 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217277 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217354 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217432 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217517 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217597 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217675 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217751 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217828 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217905 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.217996 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.218076 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.218154 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.218328 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.218951 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.219091 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.219196 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.219284 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.219399 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.219489 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.219568 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.219659 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.219825 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.219913 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.220000 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.220086 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.220166 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.220253 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.220345 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.220424 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.220502 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.220614 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.220701 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.220920 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.221007 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.221227 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.221312 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.221533 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.221617 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.221842 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.221928 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.222146 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.222239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.222450 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.222543 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.222755 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.222848 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.223061 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.223146 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.223364 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.223503 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.223964 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.224063 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.224293 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.224379 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.224603 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.224702 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.224909 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.224995 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.225205 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.225302 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.225515 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.225612 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.225819 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.225906 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.226117 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.226202 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.226423 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.226509 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.226724 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.226809 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.227029 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.227126 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.227334 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.227427 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.227632 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.227738 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.227962 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.228049 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.228261 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.228355 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.228570 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.228656 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.228874 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.228959 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.229171 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.229260 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.229467 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.229552 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.229772 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.229865 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.230074 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.230158 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.230372 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.230457 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.230677 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.230774 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.230973 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.231059 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.231282 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.231405 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.231582 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.231698 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.231903 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.231988 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.232200 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.232298 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.232508 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.232602 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.232812 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.232897 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.233108 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.233194 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.233425 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.233560 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.233727 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.233833 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.234093 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.234257 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.234428 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.234560 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.234698 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.234793 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.235014 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.235137 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.235323 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.235419 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.235637 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.235754 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.235975 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.236082 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.236291 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.236393 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.236587 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.236686 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.236899 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.237000 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.237201 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.237296 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.237501 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.237591 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.237805 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.237913 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.238910 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.238997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.238997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.239141 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.239218 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.239305 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.239385 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.239471 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.239549 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.239634 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.239732 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.239824 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.239918 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.240004 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.240534 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.240666 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.240776 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.240895 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.241014 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.241119 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.241229 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.241337 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.241450 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.241614 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.241733 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.241923 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.242052 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.242236 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.242358 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.242550 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.242672 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.242856 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.242969 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.243161 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.243281 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.243469 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.243582 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.243801 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.243935 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.244104 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.244227 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.244408 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.244519 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.244713 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.244832 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.245076 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.245204 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.245311 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.245423 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.245604 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.245717 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.246095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.246227 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.246350 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.246517 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.246643 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.246772 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.246909 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.247033 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.247161 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.247335 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.247517 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.247641 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.247796 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.248051 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.248225 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.248351 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.248483 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.248618 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.248740 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.248893 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.249047 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.249199 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.249328 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.249531 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.249661 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.249924 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.250125 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.250329 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.250529 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.250668 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.250791 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.250913 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.251035 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.251202 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.254398 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.254565 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.254695 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.254818 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.254940 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.255061 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.255282 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.255413 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.255552 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.255751 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.255751 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.255994 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.256133 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.256258 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.256381 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.256502 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.256631 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.256753 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.256883 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.257005 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.257126 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.257260 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.257390 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.257513 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.257647 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.257776 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.257906 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.258038 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.258161 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.258290 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.258420 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.258543 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.258671 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.258793 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.258923 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.259053 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.259197 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.259337 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.259463 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.259585 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.259722 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.259844 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.259966 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.260105 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.260229 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.260358 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.260482 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.260616 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.260739 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.260869 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.260992 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.261130 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.261294 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.261455 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.261617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.261788 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.261962 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.262100 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.262243 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.262384 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.262546 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.262679 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.262803 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.262924 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.263044 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.263164 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.263298 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.263421 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.263551 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.263689 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.263812 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.263933 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.263933 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.264180 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.264180 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.264409 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.264530 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.264661 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.264791 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.264914 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.265035 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.265805 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.266002 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.266220 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.266430 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.266587 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.266711 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.266835 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.266956 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.267086 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.267210 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.267332 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.267460 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.267583 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.267743 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.267884 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.268009 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.268130 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.268266 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.268389 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.268511 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.268648 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.268771 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.268896 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.269018 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.269140 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.269311 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.269443 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.269566 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.269688 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.269809 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.269921 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.270049 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.270178 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.270301 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.270423 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.270544 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.270665 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.270794 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.270925 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.271049 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.271170 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.271301 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.271431 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.271566 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.271704 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.271828 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.271950 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.272072 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.272210 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.272333 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.272454 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.272576 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.272704 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.272826 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.272826 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.273065 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.273186 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.273306 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.273428 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.273548 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.273668 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.273796 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.273918 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.274040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.274166 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.274287 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.274416 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.274546 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.274699 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.274823 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.274952 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.275148 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.275273 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.275401 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.275535 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.275657 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.275803 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.276010 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.276140 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.276270 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.276392 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.276513 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.276635 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.276947 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.277074 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.277248 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.277382 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.277565 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.277691 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.277891 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.278017 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.278216 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.278351 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.278524 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.278659 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.278853 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.278986 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.279168 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.279292 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.279479 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.279612 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.279816 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.279955 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.280133 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.280257 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.280431 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.280569 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.280756 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.281377 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.281642 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.281846 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.282083 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.282225 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.282351 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.282523 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.282657 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.282833 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.283042 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.283168 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.283297 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.283427 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.283557 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.283731 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.283875 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.284053 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.284171 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.284352 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.284479 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.284668 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.284795 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.284972 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.285099 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.285273 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.285398 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.285574 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.285700 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.285873 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.286019 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.286223 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.286350 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.286481 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.286609 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.286807 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.287015 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.287152 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.287285 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.287416 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.287547 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.287738 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.287864 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.288050 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.288194 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.288368 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.288508 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.288679 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.288806 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.289317 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.289489 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.289644 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.289810 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.289978 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.290141 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.290296 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.290463 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.290633 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.290794 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.290953 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.290953 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.291257 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.291417 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.291573 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.292840 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.293016 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.293186 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.293368 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.293368 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.293703 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.293879 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.294050 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.294221 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.294394 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.294617 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.294785 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.294968 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.295143 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.295314 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.295490 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.295754 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.295911 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.296080 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.296345 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.296581 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.296861 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.297142 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.297405 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.297575 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.297745 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.297925 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.298109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.298109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.298435 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.298607 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.298777 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.298958 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.299137 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.299317 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.299492 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.299662 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.299878 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.300060 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.300231 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.300403 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.300573 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.300743 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.300937 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.301122 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.301292 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.301462 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.301633 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.301817 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.301999 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.302176 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.302355 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.302538 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.302713 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.302889 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.303067 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.303237 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.303412 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.303588 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.303761 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.303948 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.304131 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.304307 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.304474 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.304651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.304826 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.305005 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.305188 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.305362 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.305530 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.305708 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.305895 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.306074 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.306243 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.306486 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.306671 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.306850 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.307030 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.307207 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.307377 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.307377 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.307731 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.307921 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.308105 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.308284 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.308454 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.308624 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.308793 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.308964 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.309147 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.309324 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.309493 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.309670 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.309846 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.310025 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.310200 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.310370 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.310548 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.310722 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.310893 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.311076 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.311260 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.311442 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.311616 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.311815 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.312056 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.312365 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.312627 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.312899 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.313064 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.313241 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.313411 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.313590 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.313767 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.313937 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.314106 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.314278 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.314460 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.314629 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.314806 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.315017 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.315167 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.315340 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.315519 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.315739 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.315960 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.316112 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.316287 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.316561 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.316818 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.317053 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.317232 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.317405 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.317574 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.317749 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.317932 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.318129 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.318129 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.318443 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.318616 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.318799 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.318967 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.319090 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.319090 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.319329 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.319451 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.319581 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.319720 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.319845 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.319966 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.320100 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.320226 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.320361 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.320485 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.320606 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.320728 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.320849 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.320849 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.321087 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.321207 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.321330 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.321330 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.321558 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.321688 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.321811 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.321949 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.322079 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.322202 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.322325 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.322454 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.322576 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.322697 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.322819 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.322976 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.323124 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.323254 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.323377 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.323876 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.324013 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.324137 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.324267 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.324391 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.324514 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.324635 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.324747 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.324868 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.324997 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.325131 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.325299 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.325427 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.325928 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.326054 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.326054 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.326368 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.326492 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.327202 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.327336 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.327468 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.328194 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.328368 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.328579 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.328789 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.328968 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.329111 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.329234 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.329355 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.329476 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.329596 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.329719 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.329849 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.329849 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.330078 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.330199 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.330319 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.330447 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.330578 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.330703 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.330823 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.330944 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.331064 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.331192 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.331314 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.331426 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.331545 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.331679 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.331816 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.331948 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.332092 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.332216 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.332216 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.332445 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.332566 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.333069 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.333198 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.333321 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.333443 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.333572 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.333705 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.333829 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.333958 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.334081 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.334203 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.334333 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.334465 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.334594 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.334718 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.334832 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.334938 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.335067 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.335206 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.335329 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.335451 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.335590 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.335743 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.336249 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.336399 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.336524 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.336646 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.336864 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.336992 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.337123 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.337247 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.337369 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.337491 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.337612 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.337734 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.337863 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.338029 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.338196 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.338321 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.338651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.338808 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.338944 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.339069 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.339192 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.339321 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.339444 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.339579 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.339720 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.339846 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.339968 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340066 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340149 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340236 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340317 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340395 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340473 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340550 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340627 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340718 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340799 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340885 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.340972 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341058 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341146 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341234 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341315 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341393 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341471 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341549 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341634 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341634 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341778 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341856 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.341940 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342027 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342119 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342208 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342289 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342289 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342289 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342289 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342643 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342733 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342813 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342892 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.342959 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.343096 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.343209 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.343357 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.344072 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.344191 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.344275 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.344517 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.344655 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.344788 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.344911 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.345024 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.345146 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.345146 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.345146 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.345531 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.345654 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.345785 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.345917 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.346040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.346162 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.346283 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.346405 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.346527 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.346662 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.346785 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.347003 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.347130 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.347260 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.347382 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.347513 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.347657 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.347820 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.347968 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.348104 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.348104 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.348394 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.348521 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.348644 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.349018 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.349141 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.349272 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.349669 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.349803 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.349926 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.350049 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.350170 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.350323 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.350473 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.350606 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.350763 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.350895 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.351026 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.351159 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.351283 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110301) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 08:36:30.351424 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.351424 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.351656 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.351991 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.352311 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.352629 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.352943 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.353279 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.353590 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.353902 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.354212 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.354523 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.354834 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.355147 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.355456 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.355816 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.356161 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.356412 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.356758 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.357068 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.357356 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.357672 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.357999 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.358309 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.358617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.358957 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.359276 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.359583 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.359918 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.360229 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.360534 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.360848 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.361174 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.361486 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.361810 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.362120 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.362438 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.362766 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.363115 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.363424 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.363800 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.364128 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.364440 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.364749 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.365051 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:36:30.365296 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 08:36:30.413629 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO dbcounter [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Registered counter for database nova_api Jul 18 08:36:30.426848 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO dbcounter [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] Registered counter for database nova_api Jul 18 08:36:30.526795 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_db.sqlalchemy.engines [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:36:30.534306 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writer thread running {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:36:30.541232 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG oslo_db.sqlalchemy.engines [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:36:30.548397 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG dbcounter [-] [110302] Writer thread running {{(pid=110302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:36:30.591471 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.context [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a95f31f0-4a9c-41fb-bbc6-aecf1d775be2(cell1) {{(pid=110301) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 08:36:30.595885 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:36:30.597468 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:36:30.598273 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:36:30.600735 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:36:30.602716 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO dbcounter [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Registered counter for database nova_cell0 Jul 18 08:36:30.604322 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.context [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a95f31f0-4a9c-41fb-bbc6-aecf1d775be2(cell1) {{(pid=110302) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 08:36:30.606707 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO dbcounter [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Registered counter for database nova_cell1 Jul 18 08:36:30.608310 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG oslo_concurrency.lockutils [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:36:30.610109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG oslo_concurrency.lockutils [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:36:30.610893 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG oslo_concurrency.lockutils [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:36:30.613080 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG oslo_concurrency.lockutils [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110302) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:36:30.614727 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_db.sqlalchemy.engines [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:36:30.615119 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO dbcounter [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] Registered counter for database nova_cell0 Jul 18 08:36:30.616491 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_db.sqlalchemy.engines [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:36:30.619086 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO dbcounter [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] Registered counter for database nova_cell1 Jul 18 08:36:30.622711 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writer thread running {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:36:30.624013 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writer thread running {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:36:30.627574 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG oslo_db.sqlalchemy.engines [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:36:30.628407 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG oslo_db.sqlalchemy.engines [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:36:30.635447 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG dbcounter [-] [110302] Writer thread running {{(pid=110302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:36:30.636751 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG dbcounter [-] [110302] Writer thread running {{(pid=110302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:36:30.772903 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO dbcounter [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Registered counter for database nova_cell0 Jul 18 08:36:30.782150 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_db.sqlalchemy.engines [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110301) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:36:30.782999 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO dbcounter [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] Registered counter for database nova_cell0 Jul 18 08:36:30.786882 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writer thread running {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:36:30.791626 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG oslo_db.sqlalchemy.engines [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:36:30.796035 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG dbcounter [-] [110302] Writer thread running {{(pid=110302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:36:31.232185 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: WARNING keystonemiddleware.auth_token [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 08:36:31.239661 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: WARNING keystonemiddleware.auth_token [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 08:36:31.254118 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: WARNING keystonemiddleware.auth_token [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 08:36:31.261564 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: WARNING keystonemiddleware.auth_token [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 08:36:31.582331 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: WARNING keystonemiddleware.auth_token [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 08:36:31.588223 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: WARNING keystonemiddleware.auth_token [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 08:36:31.593473 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5574a10f69c0 pid: 110301 (default app) Jul 18 08:36:31.595524 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:36:31.596726 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001753 Jul 18 08:36:31.597133 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Mon Jul 18 08:36:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:36:31.605041 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: WARNING keystonemiddleware.auth_token [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 08:36:31.611197 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: WARNING keystonemiddleware.auth_token [None req-79bd8b45-7b80-48d3-a0fc-306cca17f2dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 08:36:31.616370 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5574a10f69c0 pid: 110302 (default app) Jul 18 08:37:54.086249 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:37:54.088405 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002237 Jul 18 08:37:54.089733 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:37:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:37:54.104553 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG dbcounter [-] [110302] Writing DB stats nova_api:SELECT=3 {{(pid=110302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:54.107721 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG dbcounter [-] [110302] Writing DB stats nova_cell1:SELECT=3 {{(pid=110302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:54.108823 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG dbcounter [-] [110302] Writing DB stats nova_cell0:SELECT=3 {{(pid=110302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:54.109873 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG dbcounter [-] [110302] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:55.180025 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-2a0d8f7b-aa21-4a36-b6ce-176795141621 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:37:55.215524 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-2a0d8f7b-aa21-4a36-b6ce-176795141621 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.117264 Jul 18 08:37:55.218350 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 08:37:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:37:58.171250 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:37:58.172369 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-f31be3de-94ab-4481-ba77-efaeed72f833 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jul 18 08:37:58.172767 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:37:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:37:58.917808 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-7f35c2f0-6a4a-498d-8002-d7aac65475bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "disk": 1}} {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:37:58.935934 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:37:58.935934 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: warnings.warn(msg) Jul 18 08:37:59.092861 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-7f35c2f0-6a4a-498d-8002-d7aac65475bf admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.913094 Jul 18 08:37:59.093760 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 08:37:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:37:59.119108 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writing DB stats nova_api:SELECT=3 {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:59.120869 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writing DB stats nova_cell1:SELECT=3 {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:59.122689 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writing DB stats nova_cell0:SELECT=3 {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:59.124081 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:37:59.560100 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-20397f6a-8695-4a8d-ade0-97978fe288d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:37:59.563721 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:37:59.563721 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: warnings.warn(msg) Jul 18 08:37:59.715923 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-20397f6a-8695-4a8d-ade0-97978fe288d7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.607329 Jul 18 08:37:59.724230 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Mon Jul 18 08:37:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:38:02.306424 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-7f35c2f0-6a4a-498d-8002-d7aac65475bf admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:02.309654 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-7f35c2f0-6a4a-498d-8002-d7aac65475bf admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003629 Jul 18 08:38:02.310471 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:38:02 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:03.056903 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-f86c77ed-1e72-4c97-9458-c3f3438ddc33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1"}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:03.077410 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:38:03.077410 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: warnings.warn(msg) Jul 18 08:38:03.191959 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-f86c77ed-1e72-4c97-9458-c3f3438ddc33 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.874322 Jul 18 08:38:03.192635 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 08:38:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:38:03.205554 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-3776e0d8-bcc2-4ac8-acb4-d669ed0324bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:03.207040 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:38:03.207040 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: warnings.warn(msg) Jul 18 08:38:03.326570 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-3776e0d8-bcc2-4ac8-acb4-d669ed0324bb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124559 Jul 18 08:38:03.336389 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Mon Jul 18 08:38:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:38:05.646404 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-f86c77ed-1e72-4c97-9458-c3f3438ddc33 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:05.647488 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-f86c77ed-1e72-4c97-9458-c3f3438ddc33 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 18 08:38:05.658889 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:38:05 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:06.196647 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-c165b780-a9c8-4898-a036-d6e4e30019e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "swap": 0, "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:06.310652 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-c165b780-a9c8-4898-a036-d6e4e30019e4 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.655525 Jul 18 08:38:06.311850 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 08:38:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:38:06.328581 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-c749d89a-6983-4502-a3de-c3ca7fd82995 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:06.416238 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-c749d89a-6983-4502-a3de-c3ca7fd82995 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091487 Jul 18 08:38:06.417783 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Mon Jul 18 08:38:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:38:09.213423 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-c165b780-a9c8-4898-a036-d6e4e30019e4 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:09.215180 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-c165b780-a9c8-4898-a036-d6e4e30019e4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Jul 18 08:38:09.215458 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:38:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:09.733878 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-1d671ff4-5dff-4db3-adbf-6ca10ec2ac6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "id": "d3"}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:09.806143 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-1d671ff4-5dff-4db3-adbf-6ca10ec2ac6f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.580100 Jul 18 08:38:09.806703 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 08:38:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:38:09.819043 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-45a2c0e1-ea7c-4671-aac0-8d66ea485995 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:09.907736 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-45a2c0e1-ea7c-4671-aac0-8d66ea485995 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092378 Jul 18 08:38:09.908729 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Mon Jul 18 08:38:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:38:12.556459 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-1d671ff4-5dff-4db3-adbf-6ca10ec2ac6f admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:12.558595 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-1d671ff4-5dff-4db3-adbf-6ca10ec2ac6f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002614 Jul 18 08:38:12.559110 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:38:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:13.038570 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-2661f96d-155c-4161-9403-ec89ee7a44a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:13.132152 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-2661f96d-155c-4161-9403-ec89ee7a44a2 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.565438 Jul 18 08:38:13.143646 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 08:38:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:38:13.151439 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-9b26389c-fc07-4a26-acc7-e6bbea0e9e2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:13.237719 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-9b26389c-fc07-4a26-acc7-e6bbea0e9e2e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091467 Jul 18 08:38:13.238730 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Mon Jul 18 08:38:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:38:15.709633 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-2661f96d-155c-4161-9403-ec89ee7a44a2 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:15.711520 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-2661f96d-155c-4161-9403-ec89ee7a44a2 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002584 Jul 18 08:38:15.712356 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:38:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:16.254399 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-08a07bcf-be40-43a0-bea1-097eb16a2aa7 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:16.296012 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-08a07bcf-be40-43a0-bea1-097eb16a2aa7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.575299 Jul 18 08:38:16.296952 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 08:38:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:38:19.047952 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-2661f96d-155c-4161-9403-ec89ee7a44a2 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:19.048937 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-2661f96d-155c-4161-9403-ec89ee7a44a2 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jul 18 08:38:19.049355 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:19.603943 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-f8f0f9f0-957c-4623-95a1-6cb7462091ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:19.703927 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-f8f0f9f0-957c-4623-95a1-6cb7462091ae admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.647236 Jul 18 08:38:19.704485 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 08:38:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:38:19.718153 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-55397162-1ab0-4c8d-be2b-0950de9fa912 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:19.812256 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-55397162-1ab0-4c8d-be2b-0950de9fa912 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098777 Jul 18 08:38:19.812993 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Mon Jul 18 08:38:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:38:22.299229 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-f8f0f9f0-957c-4623-95a1-6cb7462091ae admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:22.300990 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-f8f0f9f0-957c-4623-95a1-6cb7462091ae admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001983 Jul 18 08:38:22.301714 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:38:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:22.776226 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-425f88d5-ad55-4d1d-bdd7-b461cb4155d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "name": "m1.small"}} {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:22.918826 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-425f88d5-ad55-4d1d-bdd7-b461cb4155d5 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.609042 Jul 18 08:38:22.919518 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 08:38:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:38:22.933170 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-8977a23b-692d-4c52-b67e-739ff4b42865 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:23.021294 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-8977a23b-692d-4c52-b67e-739ff4b42865 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092580 Jul 18 08:38:23.022298 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Mon Jul 18 08:38:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:38:25.507342 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-425f88d5-ad55-4d1d-bdd7-b461cb4155d5 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:25.508890 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-425f88d5-ad55-4d1d-bdd7-b461cb4155d5 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Jul 18 08:38:25.515872 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:38:25 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:26.034868 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-162a753f-f89d-486b-8d5e-aabaac137570 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "ram": 4096, "name": "m1.medium", "disk": 40}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:26.115349 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-162a753f-f89d-486b-8d5e-aabaac137570 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.597896 Jul 18 08:38:26.116152 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 08:38:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:38:26.130064 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-4312f43e-243b-4306-8f02-4d4550e3bfdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:26.138569 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG dbcounter [-] [110302] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=110302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:26.233946 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-4312f43e-243b-4306-8f02-4d4550e3bfdf admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107656 Jul 18 08:38:26.235366 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Mon Jul 18 08:38:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:38:28.686539 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-162a753f-f89d-486b-8d5e-aabaac137570 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:28.688509 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-162a753f-f89d-486b-8d5e-aabaac137570 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002527 Jul 18 08:38:28.691979 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:38:28 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:29.223504 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-f730b859-8786-492e-8b27-78b317fc9f65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "ram": 8192, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:29.303805 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-f730b859-8786-492e-8b27-78b317fc9f65 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.607965 Jul 18 08:38:29.306868 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 08:38:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:38:29.331209 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-6c519177-55e2-4a46-99ec-a8b682e2ef74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:29.567417 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-6c519177-55e2-4a46-99ec-a8b682e2ef74 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.250335 Jul 18 08:38:29.568169 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Mon Jul 18 08:38:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:38:32.076297 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-f730b859-8786-492e-8b27-78b317fc9f65 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:32.077523 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-f730b859-8786-492e-8b27-78b317fc9f65 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 18 08:38:32.079809 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:38:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:32.667518 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-105d86fa-5b81-4904-8208-1e87258a2690 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:32.676729 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:33.046531 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-105d86fa-5b81-4904-8208-1e87258a2690 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.962393 Jul 18 08:38:33.047521 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Mon Jul 18 08:38:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:38:33.066845 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-568cff74-1ca4-4ccb-9f53-95029b8579fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:38:33.195971 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-568cff74-1ca4-4ccb-9f53-95029b8579fb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135023 Jul 18 08:38:33.197685 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Mon Jul 18 08:38:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:38:53.670819 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-105d86fa-5b81-4904-8208-1e87258a2690 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:53.671874 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-105d86fa-5b81-4904-8208-1e87258a2690 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 18 08:38:53.672275 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:38:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:53.683781 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG dbcounter [-] [110302] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=110302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:38:54.078575 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-9515821c-fcb6-4012-8a77-2b637311b448 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:54.096798 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-9515821c-fcb6-4012-8a77-2b637311b448 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.418414 Jul 18 08:38:54.097343 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 08:38:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:38:55.209553 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-105d86fa-5b81-4904-8208-1e87258a2690 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:55.211221 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-105d86fa-5b81-4904-8208-1e87258a2690 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Jul 18 08:38:55.211882 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:38:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:55.774545 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-60b28bed-a7e8-4f36-a416-64d27117a6df admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:55.780325 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.wsgi [None req-60b28bed-a7e8-4f36-a416-64d27117a6df admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-60b28bed-a7e8-4f36-a416-64d27117a6df admin admin] Request method failure captured: Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Accept: application/json Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Accept-Encoding: gzip, deflate Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Connection: keep-alive Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Content-Length: 0 Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Host: 10.222.0.57 Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Openstack-Api-Version: compute 2.90 Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Openstack-System-Scope: None Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: User-Agent: python-novaclient Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Auth-Token: gAAAAABi1RwfZ8Yn5NuCoQrJHUzCbh0rQpCue1BV0QgLxZvQZMj7kwMhHR80NEqMWIAa4PsEIzrGxeoVH6FfqJWzq52LnJIjN7Z9mFaSeVqFvvHQaL7yz6TqqFcFfeb8IH_7PBPXb9Kt9eZLKDRtlfTRaki8RdUwj6UhU8Y3D56_Fsp0OrEacxQ Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Domain-Id: None Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Domain-Name: None Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Identity-Status: Confirmed Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Is-Admin-Project: True Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Domain-Id: default Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Domain-Name: Default Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Name: admin Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Role: reader,admin,member Jul 18 08:38:55.783624 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Roles: reader,admin,member Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eedba945f8d24629a712fbf156a2209f", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Tenant: admin Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Tenant-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Tenant-Name: admin Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User: admin Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Domain-Id: default Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Domain-Name: Default Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Id: 93ad24fe28ec40dbbca364cbdb34972d Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Name: admin Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: method: > Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: exception: Flavor 42 could not be found. Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: action_args: {'id': '42'} Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:38:55.785318 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:55.786375 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:55.788095 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-60b28bed-a7e8-4f36-a416-64d27117a6df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:38:55.790781 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-60b28bed-a7e8-4f36-a416-64d27117a6df admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.430856 Jul 18 08:38:55.790781 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 08:38:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:55.795420 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-19fabd47-b914-4905-8446-3a04ba8d8ccf admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:55.817295 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-19fabd47-b914-4905-8446-3a04ba8d8ccf admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025694 Jul 18 08:38:55.817867 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 08:38:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:38:55.828930 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-7a40d2e2-88b0-427f-89fd-7acbe16d54a1 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:55.853285 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-7a40d2e2-88b0-427f-89fd-7acbe16d54a1 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027964 Jul 18 08:38:55.853858 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 08:38:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:38:55.863505 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-1aa72f16-b053-40c0-bed8-31a27b5c6490 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:55.870909 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.wsgi [None req-1aa72f16-b053-40c0-bed8-31a27b5c6490 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-1aa72f16-b053-40c0-bed8-31a27b5c6490 admin admin] Request method failure captured: Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Accept: application/json Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Accept-Encoding: gzip, deflate Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Connection: keep-alive Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Content-Length: 0 Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Host: 10.222.0.57 Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Openstack-Api-Version: compute 2.90 Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Openstack-System-Scope: None Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: User-Agent: python-novaclient Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Auth-Token: gAAAAABi1RwfZ8Yn5NuCoQrJHUzCbh0rQpCue1BV0QgLxZvQZMj7kwMhHR80NEqMWIAa4PsEIzrGxeoVH6FfqJWzq52LnJIjN7Z9mFaSeVqFvvHQaL7yz6TqqFcFfeb8IH_7PBPXb9Kt9eZLKDRtlfTRaki8RdUwj6UhU8Y3D56_Fsp0OrEacxQ Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Domain-Id: None Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Domain-Name: None Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Identity-Status: Confirmed Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Is-Admin-Project: True Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Domain-Id: default Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Domain-Name: Default Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Name: admin Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Role: reader,admin,member Jul 18 08:38:55.874487 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Roles: reader,admin,member Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eedba945f8d24629a712fbf156a2209f", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Tenant: admin Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Tenant-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Tenant-Name: admin Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User: admin Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Domain-Id: default Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Domain-Name: Default Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Id: 93ad24fe28ec40dbbca364cbdb34972d Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Name: admin Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: method: > Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: exception: Flavor 42 could not be found. Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: action_args: {'id': '42'} Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:38:55.881851 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:55.883881 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:55.885639 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-1aa72f16-b053-40c0-bed8-31a27b5c6490 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:38:55.886890 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-1aa72f16-b053-40c0-bed8-31a27b5c6490 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016088 Jul 18 08:38:55.886890 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 08:38:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:56.888957 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-7a40d2e2-88b0-427f-89fd-7acbe16d54a1 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:56.889964 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-7a40d2e2-88b0-427f-89fd-7acbe16d54a1 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 18 08:38:56.890362 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:38:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:57.550602 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-1e36321c-d89c-4587-8ca8-60d082661399 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:57.556716 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.wsgi [None req-1e36321c-d89c-4587-8ca8-60d082661399 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-1e36321c-d89c-4587-8ca8-60d082661399 admin admin] Request method failure captured: Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Accept: application/json Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Accept-Encoding: gzip, deflate Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Connection: keep-alive Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Content-Length: 0 Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Host: 10.222.0.57 Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Openstack-Api-Version: compute 2.90 Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Openstack-System-Scope: None Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: User-Agent: python-novaclient Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Auth-Token: gAAAAABi1RwgZJUZawSlT0WeS_pJogOt8dSHJ7L-1AggL71P4Lu5ooipTxNTmzMxANKEAb9l7jE2Ll8eu9_ycUKl2kxs3LdroUjbGNhlHKxesua9PDlNCllp7HxzPpHrUwLH6NrbwvkU-5QH5sGQoXyHvlwXT293Bc4D9KiLh1c6prrUEVVY-RY Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Domain-Id: None Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Domain-Name: None Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Identity-Status: Confirmed Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Is-Admin-Project: True Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Domain-Id: default Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Domain-Name: Default Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Name: admin Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Role: reader,admin,member Jul 18 08:38:57.558219 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Roles: reader,admin,member Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eedba945f8d24629a712fbf156a2209f", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Tenant: admin Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Tenant-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Tenant-Name: admin Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User: admin Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Domain-Id: default Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Domain-Name: Default Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Id: 93ad24fe28ec40dbbca364cbdb34972d Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Name: admin Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: method: > Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: exception: Flavor 84 could not be found. Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: action_args: {'id': '84'} Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:38:57.559771 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:57.560752 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:57.562050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-1e36321c-d89c-4587-8ca8-60d082661399 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:38:57.563257 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-1e36321c-d89c-4587-8ca8-60d082661399 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.531411 Jul 18 08:38:57.563257 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 08:38:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 533 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 08:38:57.569392 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-384b102b-3b23-41e5-bc9b-7b2cbd044e9d admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:57.583794 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-384b102b-3b23-41e5-bc9b-7b2cbd044e9d admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017923 Jul 18 08:38:57.584341 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 08:38:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:38:57.595997 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-f881b9da-5518-4f46-b514-7d9bafd84df8 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:57.610158 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-f881b9da-5518-4f46-b514-7d9bafd84df8 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017991 Jul 18 08:38:57.610720 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 08:38:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:38:57.621009 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-d664c83b-fa8c-4e98-a694-cacc7e2f5b79 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:57.626542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.wsgi [None req-d664c83b-fa8c-4e98-a694-cacc7e2f5b79 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-d664c83b-fa8c-4e98-a694-cacc7e2f5b79 admin admin] Request method failure captured: Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Accept: application/json Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Accept-Encoding: gzip, deflate Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Connection: keep-alive Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Content-Length: 0 Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Host: 10.222.0.57 Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Openstack-Api-Version: compute 2.90 Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Openstack-System-Scope: None Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: User-Agent: python-novaclient Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Auth-Token: gAAAAABi1RwgZJUZawSlT0WeS_pJogOt8dSHJ7L-1AggL71P4Lu5ooipTxNTmzMxANKEAb9l7jE2Ll8eu9_ycUKl2kxs3LdroUjbGNhlHKxesua9PDlNCllp7HxzPpHrUwLH6NrbwvkU-5QH5sGQoXyHvlwXT293Bc4D9KiLh1c6prrUEVVY-RY Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Domain-Id: None Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Domain-Name: None Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Identity-Status: Confirmed Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Is-Admin-Project: True Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Domain-Id: default Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Domain-Name: Default Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Name: admin Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Role: reader,admin,member Jul 18 08:38:57.628109 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Roles: reader,admin,member Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eedba945f8d24629a712fbf156a2209f", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Tenant: admin Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Tenant-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Tenant-Name: admin Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User: admin Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Domain-Id: default Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Domain-Name: Default Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Id: 93ad24fe28ec40dbbca364cbdb34972d Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Name: admin Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: method: > Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: exception: Flavor 84 could not be found. Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: action_args: {'id': '84'} Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:38:57.629651 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:57.630542 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:57.631997 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-d664c83b-fa8c-4e98-a694-cacc7e2f5b79 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:38:57.633942 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-d664c83b-fa8c-4e98-a694-cacc7e2f5b79 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012684 Jul 18 08:38:57.633942 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Jul 18 08:38:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 08:38:58.613260 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-f881b9da-5518-4f46-b514-7d9bafd84df8 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:58.614261 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-f881b9da-5518-4f46-b514-7d9bafd84df8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 18 08:38:58.614653 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:38:59.148180 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-11148a8c-ef08-4c18-938e-86a5d84fdeb6 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:59.154126 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.wsgi [None req-11148a8c-ef08-4c18-938e-86a5d84fdeb6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-11148a8c-ef08-4c18-938e-86a5d84fdeb6 admin admin] Request method failure captured: Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Accept: application/json Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Accept-Encoding: gzip, deflate Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Connection: keep-alive Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Content-Length: 0 Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Host: 10.222.0.57 Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Openstack-Api-Version: compute 2.90 Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Openstack-System-Scope: None Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: User-Agent: python-novaclient Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Auth-Token: gAAAAABi1Rwi0vVvsWGodXMt0RNtCf6I7-8a2eaIZWpTtlXAm6jZaA3V6QOrr-tOvMWfdDupStmPJajSlPInJTuyi7Jby4WJjzBU3TJ5m69AxCJQYfUxjUmhpwiR4g09DI5mKQoLvfRQ3GJoCCOoj6sXgcamc7sBBafBFYIrN_bbsRPKR-hJKOI Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Domain-Id: None Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Domain-Name: None Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Identity-Status: Confirmed Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Is-Admin-Project: True Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Domain-Id: default Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Domain-Name: Default Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Project-Name: admin Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Role: reader,admin,member Jul 18 08:38:59.155617 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Roles: reader,admin,member Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eedba945f8d24629a712fbf156a2209f", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Tenant: admin Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Tenant-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-Tenant-Name: admin Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User: admin Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Domain-Id: default Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Domain-Name: Default Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Id: 93ad24fe28ec40dbbca364cbdb34972d Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: X-User-Name: admin Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: method: > Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: exception: Flavor 451 could not be found. Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: action_args: {'id': '451'} Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:38:59.161239 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:59.162058 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: ERROR nova.api.openstack.wsgi Jul 18 08:38:59.163250 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-11148a8c-ef08-4c18-938e-86a5d84fdeb6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110302) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:38:59.165278 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-11148a8c-ef08-4c18-938e-86a5d84fdeb6 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.403097 Jul 18 08:38:59.165278 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 08:38:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 08:38:59.168159 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-59d7be64-53de-4359-b466-f41148b33753 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:59.183120 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-59d7be64-53de-4359-b466-f41148b33753 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019874 Jul 18 08:38:59.183692 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 08:38:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:38:59.193263 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:59.208118 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018303 Jul 18 08:38:59.208663 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Jul 18 08:38:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:38:59.218198 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-60263bdf-b48b-469a-b5d5-be524d3f5da9 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:38:59.223963 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.wsgi [None req-60263bdf-b48b-469a-b5d5-be524d3f5da9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-60263bdf-b48b-469a-b5d5-be524d3f5da9 admin admin] Request method failure captured: Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Accept: application/json Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Accept-Encoding: gzip, deflate Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Connection: keep-alive Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Content-Length: 0 Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Host: 10.222.0.57 Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Openstack-Api-Version: compute 2.90 Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Openstack-System-Scope: None Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: User-Agent: python-novaclient Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Auth-Token: gAAAAABi1Rwi0vVvsWGodXMt0RNtCf6I7-8a2eaIZWpTtlXAm6jZaA3V6QOrr-tOvMWfdDupStmPJajSlPInJTuyi7Jby4WJjzBU3TJ5m69AxCJQYfUxjUmhpwiR4g09DI5mKQoLvfRQ3GJoCCOoj6sXgcamc7sBBafBFYIrN_bbsRPKR-hJKOI Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Domain-Id: None Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Domain-Name: None Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Identity-Status: Confirmed Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Is-Admin-Project: True Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Domain-Id: default Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Domain-Name: Default Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Project-Name: admin Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Role: reader,admin,member Jul 18 08:38:59.225567 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Roles: reader,admin,member Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/eedba945f8d24629a712fbf156a2209f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_eedba945f8d24629a712fbf156a2209f", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Tenant: admin Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Tenant-Id: eedba945f8d24629a712fbf156a2209f Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-Tenant-Name: admin Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User: admin Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Domain-Id: default Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Domain-Name: Default Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Id: 93ad24fe28ec40dbbca364cbdb34972d Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: X-User-Name: admin Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: method: > Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: exception: Flavor 451 could not be found. Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: action_args: {'id': '451'} Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:38:59.227525 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:59.228662 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: ERROR nova.api.openstack.wsgi Jul 18 08:38:59.230040 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-60263bdf-b48b-469a-b5d5-be524d3f5da9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110301) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:38:59.231303 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-60263bdf-b48b-469a-b5d5-be524d3f5da9 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012885 Jul 18 08:38:59.231303 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 08:38:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 08:39:00.245916 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:39:00.246932 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 18 08:39:00.247368 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:39:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:39:00.786716 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-d38a1c4a-f31b-4d86-b190-3ec6d0c0ceba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:39:00.861766 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-d38a1c4a-f31b-4d86-b190-3ec6d0c0ceba admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.475382 Jul 18 08:39:00.862478 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Jul 18 08:39:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:39:01.857756 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:39:01.858757 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 18 08:39:01.859154 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:39:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:39:02.410774 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-a0c7381b-73c6-405d-8233-5dd791c05f91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:39:02.489433 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-a0c7381b-73c6-405d-8233-5dd791c05f91 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.490982 Jul 18 08:39:02.489994 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Jul 18 08:39:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:39:03.489013 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:39:03.490037 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 18 08:39:03.490479 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:39:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:39:04.055346 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-87d64224-18c0-4f7b-91af-569a95295ccb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:39:04.155843 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-87d64224-18c0-4f7b-91af-569a95295ccb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.523061 Jul 18 08:39:04.156347 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Jul 18 08:39:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 08:39:05.146999 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:39:05.148615 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 18 08:39:05.149722 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:39:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:39:05.708414 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-af447f7a-eab1-4b98-b2c6-c5d7d85c8522 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:39:05.792408 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-af447f7a-eab1-4b98-b2c6-c5d7d85c8522 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.498886 Jul 18 08:39:05.792985 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Jul 18 08:39:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:39:06.811274 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:39:06.812348 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 18 08:39:06.812750 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:39:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:39:07.361745 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-bac00aae-1ce2-4a89-be2a-ce60e68f2730 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:39:07.381050 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-bac00aae-1ce2-4a89-be2a-ce60e68f2730 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.428290 Jul 18 08:39:07.381578 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Mon Jul 18 08:39:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:40:00.015160 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:40:00.016196 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-cff4a5b2-8431-4a91-9e34-99e81136cce7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 18 08:40:00.016602 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Mon Jul 18 08:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:40:00.027529 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:00.422587 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-2956fecf-63aa-4eb0-a0f3-330409565b77 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:40:00.440970 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-2956fecf-63aa-4eb0-a0f3-330409565b77 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.417860 Jul 18 08:40:00.441519 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Mon Jul 18 08:40:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:40:00.462983 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG dbcounter [-] [110302] Writing DB stats nova_api:SELECT=14 {{(pid=110302) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:40:00.466931 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-d501900b-d4e3-4e64-b002-57c5ebf06673 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:40:00.474532 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-d501900b-d4e3-4e64-b002-57c5ebf06673 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012996 Jul 18 08:40:00.475056 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Mon Jul 18 08:40:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:40:00.486943 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-ad424126-18bb-4bf5-9049-2e278a74c6dc admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:40:00.495409 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-ad424126-18bb-4bf5-9049-2e278a74c6dc admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012024 Jul 18 08:40:00.496095 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Mon Jul 18 08:40:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:40:00.508879 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-d623c246-0f23-41b5-b239-516fe055f5f6 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:40:00.516740 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-d623c246-0f23-41b5-b239-516fe055f5f6 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012659 Jul 18 08:40:00.517274 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Mon Jul 18 08:40:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:40:00.529465 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-86b6bcfd-35f0-4dc5-b9a6-04f7a6a75e6b admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:40:00.537352 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-86b6bcfd-35f0-4dc5-b9a6-04f7a6a75e6b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011523 Jul 18 08:40:00.537888 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Mon Jul 18 08:40:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:43:56.576696 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-d623c246-0f23-41b5-b239-516fe055f5f6 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:43:56.577729 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-d623c246-0f23-41b5-b239-516fe055f5f6 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 18 08:43:56.578127 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:43:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:43:56.721421 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writing DB stats nova_api:SELECT=6 {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:43:56.862054 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-eced1784-7c29-4453-88e0-70dfa22ad5c5 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:43:56.863224 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:43:56.863224 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: warnings.warn(msg) Jul 18 08:43:56.864470 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-eced1784-7c29-4453-88e0-70dfa22ad5c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:43:56.864937 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-eced1784-7c29-4453-88e0-70dfa22ad5c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:43:56.865712 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-eced1784-7c29-4453-88e0-70dfa22ad5c5 admin admin] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:43:56.866133 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-eced1784-7c29-4453-88e0-70dfa22ad5c5 admin admin] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:43:56.899414 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-eced1784-7c29-4453-88e0-70dfa22ad5c5 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.179597 Jul 18 08:43:56.900009 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 08:43:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:43:57.741231 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-d623c246-0f23-41b5-b239-516fe055f5f6 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:43:57.742248 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-d623c246-0f23-41b5-b239-516fe055f5f6 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 18 08:43:57.742705 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:43:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:43:57.939083 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-90db2940-8ef3-465e-959c-1805aeb83172 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:43:57.940298 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:43:57.940298 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: warnings.warn(msg) Jul 18 08:43:57.941482 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-90db2940-8ef3-465e-959c-1805aeb83172 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:43:57.941919 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-90db2940-8ef3-465e-959c-1805aeb83172 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:43:57.942700 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-90db2940-8ef3-465e-959c-1805aeb83172 admin admin] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:43:57.943129 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-90db2940-8ef3-465e-959c-1805aeb83172 admin admin] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:43:57.964654 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-90db2940-8ef3-465e-959c-1805aeb83172 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079188 Jul 18 08:43:57.965157 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 08:43:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:44:09.237404 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-d623c246-0f23-41b5-b239-516fe055f5f6 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:44:09.238414 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-d623c246-0f23-41b5-b239-516fe055f5f6 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 18 08:44:09.238807 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:44:09.383919 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writing DB stats nova_cell0:SELECT=4 {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:44:09.384664 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writing DB stats nova_cell1:SELECT=4 {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:44:09.385273 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG dbcounter [-] [110301] Writing DB stats nova_api:SELECT=8 {{(pid=110301) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:44:09.435343 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-6512e47b-be4f-4005-af6a-f73b0959b371 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:44:09.436548 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:44:09.436548 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: warnings.warn(msg) Jul 18 08:44:09.437728 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-6512e47b-be4f-4005-af6a-f73b0959b371 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:44:09.438839 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-6512e47b-be4f-4005-af6a-f73b0959b371 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:44:09.439733 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-6512e47b-be4f-4005-af6a-f73b0959b371 admin admin] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:44:09.440165 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-6512e47b-be4f-4005-af6a-f73b0959b371 admin admin] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:44:09.466547 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-6512e47b-be4f-4005-af6a-f73b0959b371 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086934 Jul 18 08:44:09.467034 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 08:44:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:44:10.307319 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: DEBUG nova.api.openstack.wsgi [None req-d623c246-0f23-41b5-b239-516fe055f5f6 admin admin] Calling method '>' {{(pid=110302) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:44:10.308369 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: INFO nova.api.openstack.requestlog [None req-d623c246-0f23-41b5-b239-516fe055f5f6 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 18 08:44:10.308799 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: [pid: 110302|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Jul 18 08:44:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:44:10.499904 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG nova.api.openstack.wsgi [None req-6ae88e86-634b-46fc-93d4-206c473a8c17 admin admin] Calling method '>' {{(pid=110301) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:44:10.501591 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 08:44:10.501591 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: warnings.warn(msg) Jul 18 08:44:10.502838 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-6ae88e86-634b-46fc-93d4-206c473a8c17 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:44:10.503269 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-6ae88e86-634b-46fc-93d4-206c473a8c17 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:44:10.504088 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-6ae88e86-634b-46fc-93d4-206c473a8c17 admin admin] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:44:10.504507 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: DEBUG oslo_concurrency.lockutils [None req-6ae88e86-634b-46fc-93d4-206c473a8c17 admin admin] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110301) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:44:10.526398 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: INFO nova.api.openstack.requestlog [None req-6ae88e86-634b-46fc-93d4-206c473a8c17 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078847 Jul 18 08:44:10.526888 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: [pid: 110301|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Jul 18 08:44:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:45:06.304591 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: Mon Jul 18 08:45:06 2022 - graceful shutdown triggered... Jul 18 08:45:06.304691 dv-cinder-850142-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 08:45:06.305672 dv-cinder-850142-3-iscsi devstack@n-api.service[110302]: Gracefully killing worker 2 (pid: 110302)... Jul 18 08:45:06.306108 dv-cinder-850142-3-iscsi devstack@n-api.service[110301]: Gracefully killing worker 1 (pid: 110301)... Jul 18 08:45:07.306781 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: worker 1 buried after 1 seconds Jul 18 08:45:07.307345 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: worker 2 buried after 1 seconds Jul 18 08:45:07.307345 dv-cinder-850142-3-iscsi devstack@n-api.service[110300]: goodbye to uWSGI. Jul 18 08:45:07.308438 dv-cinder-850142-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 08:45:07.309014 dv-cinder-850142-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 08:45:07.311863 dv-cinder-850142-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 08:45:07.321973 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 08:45:07.324755 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 08:45:07 2022] *** Jul 18 08:45:07.324930 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 08:45:07.325048 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 08:45:07.325146 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: nodename: dv-cinder-850142-3-iscsi Jul 18 08:45:07.325246 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: machine: x86_64 Jul 18 08:45:07.325340 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: clock source: unix Jul 18 08:45:07.325432 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: pcre jit disabled Jul 18 08:45:07.325536 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: detected number of CPU cores: 4 Jul 18 08:45:07.325628 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: current working directory: / Jul 18 08:45:07.325746 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: detected binary path: /usr/bin/uwsgi-core Jul 18 08:45:07.325865 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: your processes number limit is 47680 Jul 18 08:45:07.325983 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: your memory page size is 4096 bytes Jul 18 08:45:07.326096 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: detected max file descriptor number: 2048 Jul 18 08:45:07.326206 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: lock engine: pthread robust mutexes Jul 18 08:45:07.326501 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: thunder lock: enabled Jul 18 08:45:07.326835 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 08:45:07.326969 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 08:45:07.367849 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: Python main interpreter initialized at 0x5626eb69e9c0 Jul 18 08:45:07.367849 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: python threads support enabled Jul 18 08:45:07.367849 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: your server socket listen backlog is limited to 100 connections Jul 18 08:45:07.367849 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: your mercy for graceful operations on workers is 90 seconds Jul 18 08:45:07.368495 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 08:45:07.368495 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: *** Operational MODE: preforking *** Jul 18 08:45:07.368656 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: *** uWSGI is running in multiple interpreter mode *** Jul 18 08:45:07.368656 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: spawned uWSGI master process (pid: 124875) Jul 18 08:45:07.368816 dv-cinder-850142-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 08:45:07.369342 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: spawned uWSGI worker 1 (pid: 124894, cores: 1) Jul 18 08:45:07.369443 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: spawned uWSGI worker 2 (pid: 124895, cores: 1) Jul 18 08:45:07.369520 dv-cinder-850142-3-iscsi devstack@n-api.service[124875]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 08:45:08.033935 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 08:45:08.040998 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 08:45:09.215315 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:45:09.215315 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: from cryptography.utils import int_from_bytes Jul 18 08:45:09.216001 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:45:09.216001 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: from cryptography.utils import int_from_bytes Jul 18 08:45:09.226757 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:45:09.226757 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: from cryptography.utils import int_from_bytes Jul 18 08:45:09.227304 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 08:45:09.227304 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: from cryptography.utils import int_from_bytes Jul 18 08:45:11.554012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 08:45:11.554564 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 08:45:11.554829 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 08:45:11.555172 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 08:45:11.555432 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 08:45:11.555853 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.556187 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.556510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.556832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.557164 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.557477 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.557799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.558118 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.558447 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.558714 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.559028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.559521 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850142-3-iscsi {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.559727 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.560007 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.560319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.560636 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.560939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.561263 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.561569 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.562070 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.563553 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.563553 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.563553 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.563553 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.564006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.564215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.564432 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.564719 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.565047 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.565375 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.565768 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850142-3-iscsi {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.566108 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.566406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.566709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.567121 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.567452 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.567770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.568098 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.568416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.568776 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.569069 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.569392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.569716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.570037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.570336 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.570645 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.570956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.571280 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.571583 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.571922 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.572174 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.572483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.572967 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.573135 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.573437 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.573690 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.573942 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.574261 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.574581 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.574891 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.575199 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.575503 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.575884 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.576154 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.576453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.576758 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.577137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.577382 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.577700 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.578024 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.578333 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.578657 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.579087 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.579598 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.579937 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.580348 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.580603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.580914 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.581234 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.581549 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.581866 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.582169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.582475 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.582796 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.583129 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.583434 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.583716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.584009 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.584316 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.584635 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.584944 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.585280 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.585552 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.585867 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.586174 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.586496 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.586766 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.587073 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.587381 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.587700 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.588012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.588317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.588630 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.588947 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.589268 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.589574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.589955 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.590189 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.590490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.590810 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.591115 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.591420 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.591776 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.592083 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.592386 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.592536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 08:45:11.593019 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.593183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 08:45:11.593334 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.593334 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.593627 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 08:45:11.593776 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.593917 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 08:45:11.594067 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.594219 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 08:45:11.594361 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.594509 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.595215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.595624 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.595851 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.596006 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.596174 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.596481 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.596729 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.596893 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.597045 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.597194 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.597646 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.597646 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.597942 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.598108 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.598259 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.598422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.598564 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.598824 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.598982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.599135 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.599276 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.599417 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.599557 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850142-3-iscsi {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.599747 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.600177 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.600344 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.600495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.600637 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.600796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.600941 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.601091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.601233 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.601381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.601523 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.601663 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.601663 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.601944 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.601944 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.602320 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.602502 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.602655 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.602805 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.602947 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.603106 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.603248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.603388 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.603527 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.603719 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.603870 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.604021 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.604164 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.604320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.604469 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.604700 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.604845 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.604992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.605133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.605284 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.605426 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.605663 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.605811 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850142-3-iscsi {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.605961 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.606108 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.606265 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.606579 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.606747 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.606976 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.607130 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.607130 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.607423 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.607623 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.607895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.608053 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.608196 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.608338 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.608488 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.608630 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.608780 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.609039 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.609195 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.609338 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.609488 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.609637 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.609814 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.609959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.610100 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.610959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.611195 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.611351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.611506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.611648 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.611821 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.611979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.612123 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.612349 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.612506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.612654 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.612796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.612956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.613108 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.613258 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.613414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.613575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.613724 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.613875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.614024 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.614172 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.614314 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.614454 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.614608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.614755 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.614895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.614895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.615173 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.615324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.615478 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.615639 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.615868 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.616028 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.616178 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.616332 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.616475 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.616775 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.616951 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.617173 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.617329 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.617329 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.617627 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.617776 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.617925 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.618073 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.618240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.618484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.618639 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.618796 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.618939 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.619183 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.619340 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.619498 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.619651 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.619829 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.619971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.620111 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.620264 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.620504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.620653 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.620793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.620934 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.621082 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.621237 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.621379 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.621518 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.621669 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.621816 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.621959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.622107 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.622260 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.622492 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.622677 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.622841 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.622991 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.623141 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.623289 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.623431 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.623589 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.623787 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.623946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.624098 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.624246 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.624394 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.624542 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.624683 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.624832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.624981 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.625124 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.625263 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.625409 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.625561 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.625710 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.625905 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.626128 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.626285 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.626436 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.626631 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.626960 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.627117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.627357 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.627512 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.627797 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.627965 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.628137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.628298 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.628465 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.628717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.628864 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.629004 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.629004 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.629396 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.629553 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.629704 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.629845 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.629994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.629994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.630285 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.630435 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.630678 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.630834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.630977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.631132 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.631274 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.631416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.631565 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.631790 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.631938 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.632091 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.632252 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.632403 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.632720 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.632878 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.633020 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.633169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.633318 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.633475 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.633634 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.633787 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.633937 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.634087 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.634238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.634394 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.634551 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.634693 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.634843 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.634985 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.635126 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.635279 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.635421 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.635562 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.635721 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.635881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.636023 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.636269 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.636436 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.636589 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.636738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.637052 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.637200 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.637374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.637595 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.637743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.637884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.638036 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.638177 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.638332 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.638482 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.638635 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.638907 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.639064 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.639221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.639221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.639614 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.639809 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.639954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.640102 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.640258 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.640448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.640595 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.640847 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.641012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.641163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.641325 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.642009 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.642241 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.642449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 08:45:11.642670 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.642670 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.643048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.643192 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.643339 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.643490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.643644 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.643827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.643979 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.644120 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.644261 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.644404 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.644552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.644704 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.644852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.645009 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.645151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.645299 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.645447 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.645612 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.645755 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.645896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.646037 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.646183 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.646417 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.646576 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.646720 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.646867 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.647190 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.647344 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.647495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.647778 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.647947 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.648103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.648253 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.648396 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.648552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.648694 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.648834 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.649085 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.649235 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.649385 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.649536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.649794 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.649955 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.650106 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.650258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.650400 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.650555 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.650698 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.650856 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.651075 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.651075 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.651358 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.651508 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.651658 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.651826 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.651989 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.652140 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.652297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.652448 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.652589 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.652730 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.652895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.653105 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.653266 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.653410 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.653551 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.653692 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.653833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.653990 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.654144 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.654295 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.654438 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.654585 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.654734 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.654890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.655117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.655285 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.655430 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.655571 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.655783 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.655945 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.656098 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.656247 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.656406 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.656634 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.656788 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.656940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.656940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.657972 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.657972 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.658251 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.658251 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.658540 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.658701 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.658843 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.658984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.659232 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.659389 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.659541 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.659541 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.660001 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.660150 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.660291 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.660446 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.660596 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.660596 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.660874 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.660874 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.661239 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.661239 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.661523 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.661665 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.661813 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.661961 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.662108 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.662268 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.662424 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.662580 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.662736 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.662896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.663051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.663302 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.663466 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.663624 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.663807 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.663958 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.664192 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.664192 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.664476 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.664623 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.664770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.664918 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.665085 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.665233 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.665381 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.665527 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.665674 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.665828 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.665992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.666140 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.666287 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.666433 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.666602 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.666836 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.667005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.667164 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.667164 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.667445 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.667599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.667826 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.668216 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.668373 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.668521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.668677 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.668825 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.668983 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.669133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.669405 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.669561 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.669709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.669856 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.670035 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.670284 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.670447 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.670596 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.670757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.670905 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.671052 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.671214 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.671446 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.671619 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.671803 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.671953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.672100 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.672402 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.672574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.673365 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.673640 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.673806 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.673964 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.674119 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.674268 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.674425 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.674600 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.674748 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.674895 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.675049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.675210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.675360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.675514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.675702 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.675870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.676018 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.676185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.676343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.676512 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.676661 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.676835 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.677070 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.677244 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.677402 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.677552 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.677700 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.677847 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.677993 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.678387 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.678551 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.678709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.678709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.679824 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.680005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.680163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.680331 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.680575 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.680741 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.680898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.681057 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.681207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.681207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.681600 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.681765 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.681765 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.682078 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.682236 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.682393 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.682541 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.682700 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.682849 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.683005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.683152 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.683313 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.683462 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.683627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.683875 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.684042 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.684042 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.684323 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.686865 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.687064 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.687352 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.687512 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.687764 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.687929 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.688091 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.688260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.689169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.689337 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.689486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.689634 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.689789 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.690048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.690219 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.690411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.690586 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.690826 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.690981 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.691158 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.691317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.691475 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.691752 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.691752 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.692056 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.692215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.692364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.692470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.692545 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.692676 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.692814 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.692955 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.693091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.693229 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.693358 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.693493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.693621 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.693805 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.694022 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.694200 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.694331 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.694460 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.694616 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.694848 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.694992 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.695123 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.695258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.695395 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.695537 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.695694 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.695825 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.695965 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.696093 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.696230 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.696370 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.696499 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.696626 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.696753 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.696889 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.697018 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.697154 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.697302 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.697511 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.697651 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.697787 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.697930 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.698069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.698198 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.698325 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.698469 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.698788 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.698936 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.699076 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.699214 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.699214 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.699465 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.699601 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.699781 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.699781 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.700264 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.700404 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.700535 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.700535 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.700876 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.701094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.701226 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.701362 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.701500 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.701640 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.701858 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.701998 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.702127 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.702255 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.702390 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.702390 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.702656 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.702656 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.702656 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.703008 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.703135 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.703135 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.703395 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.703532 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.703532 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.703793 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.703921 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.703921 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.704277 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.704654 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.704791 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.704920 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.704920 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.705321 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.705450 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.705450 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.705697 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.705834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.705834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.706093 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.706222 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.706222 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.706471 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.706601 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.706741 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.706872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.706872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.707119 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.707255 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.707384 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.707611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.707611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.707965 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.708095 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.708095 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.708367 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.708499 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.708626 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.708963 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.708963 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.709214 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.709357 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.709357 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.709606 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.709735 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.709869 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.710001 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.710001 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.710267 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.710482 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.710482 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.710735 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.710862 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.710862 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.711132 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.711351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.711508 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.711778 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.711778 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.712131 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.712269 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.712398 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.712574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.712574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.712823 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.712953 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.713087 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.713216 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.713216 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.713473 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.713615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.713615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.713855 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.713989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.714139 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.714342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.714342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.714595 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.714730 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.714730 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.714730 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.715090 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.715229 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.715229 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.715470 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.715604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.715604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.715879 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.716016 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.716016 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.716281 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.716410 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.717022 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.717174 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.717174 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.717437 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.717574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.717574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.717845 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.718057 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.718190 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.718325 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.718325 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.718575 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.718718 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.719073 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.719209 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.719209 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.719469 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.719699 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.719699 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.720252 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.720479 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.720651 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.720904 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.720904 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.721272 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.721509 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.721644 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.721787 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.721925 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.722149 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.722149 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.722410 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.722549 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.722549 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.722813 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.722942 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.723077 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.723205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.723205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.723463 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.723593 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.723747 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.723885 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.724015 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.724150 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.724288 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.724507 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.724507 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.724761 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.724891 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.725036 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.725165 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.725165 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.725421 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.725558 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.725696 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.725832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.725832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.726081 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.726208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.726208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.726208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.726578 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.726707 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.726845 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.726975 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.726975 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.727221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.727358 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.727358 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.727622 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.727830 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.727830 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.728177 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.728318 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.728318 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.728560 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.728695 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.728695 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.728960 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.729294 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.729428 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.729570 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.729570 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.729811 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.729953 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.729953 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.730194 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.730329 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.730458 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.730593 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.730593 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.730852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.731092 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.731224 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.731360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.731360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.731748 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.731883 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.731883 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.732149 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.732354 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.732354 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.732617 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.732745 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.732745 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.732994 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.733129 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.733277 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.733414 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.733414 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.733654 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.733788 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.733788 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.734113 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.734251 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.734387 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.734530 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.734730 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.734873 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.735010 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.735147 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.735883 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.736110 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.736242 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.736410 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.736626 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.736762 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.737036 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.737168 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.737346 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.737536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.737677 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.737951 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.738082 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.738290 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.738661 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.738805 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.738935 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.739061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.739390 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.739529 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.739699 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.739898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.740046 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.740211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.740394 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.740571 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.740845 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.740979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.741208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.741346 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.741475 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.741788 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.741945 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.742081 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.742216 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.742428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.742652 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.742784 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.743002 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.743133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.743324 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.743569 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.743724 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.744415 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.744559 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.744559 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.744914 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.745046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.745175 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.745309 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.745443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.745571 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.745973 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.746120 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.746249 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.746375 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.746503 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.746738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.746900 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.747153 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.747293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.747467 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.747798 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.747938 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.748159 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.748304 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.748512 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.748658 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.748791 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.749101 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.749232 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.749598 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.749734 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.749878 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.750015 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.750144 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.750348 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.750485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.750707 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.750959 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.751729 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.751899 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.752128 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.752341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.752498 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.752707 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.752846 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.753009 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.753249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.753382 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.753623 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.753763 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.753940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.754179 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.754313 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.754618 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.754759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.754990 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.755207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.755351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.755538 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.755702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.755976 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.756120 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.756314 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.756514 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.756646 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.756939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.757078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.757256 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.757472 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.757604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.757970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.758112 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.758344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.758492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.758745 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.758879 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.759391 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.759877 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.760035 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.760167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.760307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.760436 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.760649 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.760789 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.760919 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.761047 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.761175 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.761303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.761446 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.761584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.761721 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.761966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.762113 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.762339 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.762486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.762629 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.762857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.762997 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.763128 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.763264 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.763403 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.763542 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.763694 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.763825 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.763966 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.764110 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.764247 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.764379 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.764515 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.764653 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.764653 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.764905 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.765057 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.765266 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.765401 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.765540 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.765676 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.765828 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.766090 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.766224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.766361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.766513 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.766646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.766790 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.766982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.767117 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.767247 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.767442 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.767584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.767785 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.767927 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.768096 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.768230 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.768406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.768552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.768727 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.768898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.769056 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.769160 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.769367 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.769495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.769681 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.769794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.769990 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.770098 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.770320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.770429 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.770629 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.770721 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.770938 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.771107 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.771245 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.771428 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.771559 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.771769 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.771891 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.772089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.772223 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.772409 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.772510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.772725 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.772841 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.773051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.773164 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.773369 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.773466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.773677 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.773771 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.773984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.774088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.774298 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.774400 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.774627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.774791 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.774965 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.775103 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.775261 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.775439 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.775576 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.775843 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.775992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.776205 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.776348 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.776489 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.776627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.776773 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.776927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.777086 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.777235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.777374 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.777519 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.777659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.777811 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.777906 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.778083 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.778230 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.778369 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.778515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.778764 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.778879 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.779089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.779242 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.779483 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.779628 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.779828 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.779949 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.780155 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.780327 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.780478 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.780628 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.780799 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.780895 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.781121 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.781204 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.781432 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.781752 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.782067 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.782454 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.782631 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.782895 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.783257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.783499 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.783654 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.783830 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.783973 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.784127 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.784282 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.784427 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.784578 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.784729 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.784880 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.785030 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.785182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.785333 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.785477 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.785619 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.785768 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.785934 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.786078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.786240 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.786456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.786606 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.786745 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.786894 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.787036 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.787210 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.787210 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.788244 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.788402 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.788557 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.788715 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.788867 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.789018 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.789275 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.789433 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.789587 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.789740 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.789892 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.790186 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.790446 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.790611 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.790758 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.790912 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.791063 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.791206 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.791357 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.791684 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.791870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.792028 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.792173 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.792326 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.792591 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.792752 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.792925 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.793175 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.793175 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.793547 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.793547 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.793832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.793981 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.794138 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.794282 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.794425 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.794580 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.794731 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.794731 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.795007 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.795160 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.795303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.795455 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.795606 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.795791 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.795938 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.796081 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.796224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.796385 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.796611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.796760 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.796905 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.797049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.797213 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.797366 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.797520 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.797665 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.798356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.798356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.798649 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.798795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.798944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.799089 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.799260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.799482 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.799646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.799834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.799834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.800144 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.800361 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.800596 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.800753 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.800905 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.801062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.801207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.801351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.801504 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.801665 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.801821 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.801964 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.802106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.802249 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.802401 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.802545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.802792 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.802940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.803091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.803339 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.803581 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.803760 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.803910 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.804072 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.804216 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.804375 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.804519 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.804669 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.804819 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.804974 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.805128 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.805285 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.805441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.805592 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.805743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.805887 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.806050 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.806202 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.806345 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.806489 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.806656 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.806865 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.807014 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.807167 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.807310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.807461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.807611 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.807873 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.808036 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.808199 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.808343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.808486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.808635 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.808785 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.808941 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.809086 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.809228 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.809377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.809609 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.809760 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.809919 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.810098 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.810444 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.810625 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.810625 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.810971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.811130 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.811282 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.811433 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.811577 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.811738 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.812005 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.812156 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.812299 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.812465 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.812618 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.812771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.812924 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.813182 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.813370 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.814185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.814337 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.814481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.814634 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.814779 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.814930 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.815092 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.815237 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.815386 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.815539 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.815739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.815892 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.816044 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.816196 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.816355 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.816500 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.816653 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.816804 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.817036 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.817197 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.817355 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.817506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.817657 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.817814 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.817964 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.818121 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.818266 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.818416 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.818577 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.818722 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.818873 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.819036 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.819180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.819322 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.819468 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.819635 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.819828 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.819988 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.820141 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.820285 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.820445 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.820661 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.820836 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.821056 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.821213 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.821357 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.821508 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.821651 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.821807 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.821964 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822116 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822273 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822425 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822575 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822807 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 08:45:11.822971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.822971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.824388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.824388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.824388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.824388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.824388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.825109 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.825109 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.825109 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.825527 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.825722 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.826035 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.826352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.826668 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.826980 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.827309 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.827627 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.827961 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.828288 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.828605 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.829949 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.830309 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.830711 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.830981 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.831337 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.831662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.832030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.832366 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.832681 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.833003 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.833377 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.836199 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.836548 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.836892 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.837268 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.837603 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.837931 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.838258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.838579 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.839374 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.839374 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.839559 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.839867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.840194 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.840507 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.840927 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.841249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.841562 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.841887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.842202 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.842523 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.842834 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.843157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.843478 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.844009 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.844377 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.845575 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.845892 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.846212 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.846544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.846861 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.847192 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.847511 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.847924 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.848290 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.848618 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.849226 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.849569 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.849895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.850247 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.850578 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.850887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.851200 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.851510 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.851869 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.852187 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.852502 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.852815 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.853131 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.853451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.853795 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.854111 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.854423 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.854760 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.855071 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.855385 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.855803 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.856116 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.856435 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.856795 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.857121 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.857440 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.857761 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.858080 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.858392 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.858705 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.859015 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.859323 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.859640 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.860034 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.860403 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.860714 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.861159 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.861469 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.861790 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.862116 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.862427 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.862751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.863077 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.863396 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.863743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.864061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.864396 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.864743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.865076 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.865403 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.865830 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.866018 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.866322 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.866632 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.866955 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.867267 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.867571 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.867899 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.868209 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.868514 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.868822 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.869127 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.869434 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.869744 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.870050 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.870354 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.870658 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.870963 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.871266 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.871569 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.871904 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.872208 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.872557 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.872840 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.873151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.873455 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.873798 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.874136 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.874456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.874778 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.875091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.875413 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.875747 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.876212 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.876547 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.876868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.877176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.877514 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.877901 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.878144 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.878457 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.878768 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.879080 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.879390 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.879720 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.880059 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.880365 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.880693 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.881021 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.881340 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.881659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.881973 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.882307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.882619 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.882933 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.883249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.883561 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.883919 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.884238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.884552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.884861 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.885179 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.885498 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.885831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.886155 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.886463 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.886789 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.887119 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.887502 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.887839 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.888189 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.888515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.888832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.889145 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.889450 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 08:45:11.889694 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 08:45:11.972989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO dbcounter [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] Registered counter for database nova_api Jul 18 08:45:11.993975 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_db.sqlalchemy.engines [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:45:12.001381 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writer thread running {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:45:12.042807 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO dbcounter [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] Registered counter for database nova_api Jul 18 08:45:12.059794 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.context [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a95f31f0-4a9c-41fb-bbc6-aecf1d775be2(cell1) {{(pid=124895) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 08:45:12.063184 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_db.sqlalchemy.engines [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:45:12.063848 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:45:12.065615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:45:12.066439 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:45:12.068506 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:45:12.070250 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writer thread running {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:45:12.070565 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO dbcounter [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] Registered counter for database nova_cell0 Jul 18 08:45:12.074773 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO dbcounter [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] Registered counter for database nova_cell1 Jul 18 08:45:12.083570 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_db.sqlalchemy.engines [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:45:12.084834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_db.sqlalchemy.engines [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:45:12.091924 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writer thread running {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:45:12.093390 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writer thread running {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:45:12.129015 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.context [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a95f31f0-4a9c-41fb-bbc6-aecf1d775be2(cell1) {{(pid=124894) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 08:45:12.132905 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:45:12.134477 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:45:12.135280 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:45:12.137257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:45:12.139239 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO dbcounter [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] Registered counter for database nova_cell0 Jul 18 08:45:12.143387 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO dbcounter [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] Registered counter for database nova_cell1 Jul 18 08:45:12.151217 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_db.sqlalchemy.engines [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:45:12.153408 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_db.sqlalchemy.engines [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:45:12.161079 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writer thread running {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:45:12.161414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writer thread running {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:45:12.249098 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO dbcounter [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] Registered counter for database nova_cell0 Jul 18 08:45:12.256672 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_db.sqlalchemy.engines [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:45:12.261526 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writer thread running {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:45:12.307931 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO dbcounter [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] Registered counter for database nova_cell0 Jul 18 08:45:12.315930 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_db.sqlalchemy.engines [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 08:45:12.320637 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writer thread running {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 08:45:12.597076 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: WARNING keystonemiddleware.auth_token [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 08:45:12.604484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: WARNING keystonemiddleware.auth_token [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 08:45:12.640757 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: WARNING keystonemiddleware.auth_token [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 08:45:12.648527 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: WARNING keystonemiddleware.auth_token [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 08:45:12.974852 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: WARNING keystonemiddleware.auth_token [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 08:45:12.981229 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: WARNING keystonemiddleware.auth_token [None req-8438620d-816a-45ea-97cb-15cbc5baff9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 08:45:12.987843 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5626eb69e9c0 pid: 124895 (default app) Jul 18 08:45:13.001888 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: WARNING keystonemiddleware.auth_token [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 08:45:13.007836 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: WARNING keystonemiddleware.auth_token [None req-cb46bc92-d5d9-4497-9b3f-4cb0aff05754 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 08:45:13.013080 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5626eb69e9c0 pid: 124894 (default app) Jul 18 08:46:15.303999 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=3 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:15.308382 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=3 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:15.311374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=3 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:15.320902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=3 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:17.197133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=3 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:17.200051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=3 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:17.204816 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=3 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:17.212170 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=3 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:17.491105 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1530497466", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "networks": [{"uuid": "41c4eca8-d71d-42c2-858d-31f22a0cc589"}]}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:19.205699 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] validate_networks() for [('41c4eca8-d71d-42c2-858d-31f22a0cc589', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:46:19.380562 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8ff767c6-ff6e-49fb-b386-bc8fe2b9ce3c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Action: 'create', calling method: .version_select at 0x7fafbd2708b0>, body: {"keypair": {"name": "tempest-keypair-1424650667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDDm8rs2EcPJDDz+FJUehZzC2hJ0ZRs0X3Z8nkif5GAX7C5/NjIXyi70q3RMTmrjpNIF+0AE8XB6o45cv7s5juetGNPxeRZ5JldU+ij29MOuV6TpFAddHrOGEJThA05HQ=="}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:19.541081 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-8ff767c6-ff6e-49fb-b386-bc8fe2b9ce3c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Getting quotas for project ef2947427ce24f46baad0172db285cc8. Resources: {'key_pairs'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:46:19.563409 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-8ff767c6-ff6e-49fb-b386-bc8fe2b9ce3c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Getting quotas for user 88b4bd52ede644f0aac8dff94e09dd7d and project ef2947427ce24f46baad0172db285cc8. Resources: {'key_pairs'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:46:19.873998 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8ff767c6-ff6e-49fb-b386-bc8fe2b9ce3c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 2.684079 Jul 18 08:46:19.875243 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 1/1] 10.222.0.57 () {62 vars in 1199 bytes} [Mon Jul 18 08:46:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 2689 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 08:46:20.501218 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6d4b0a1f-902a-4788-80fd-bbcb442ec4f9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: .version_select at 0x7fafbd1e6430>, body: {"keypair": {"name": "tempest-keypair-487120895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW0q2G93uOM6wPnvUPCPa/shIE/xaG43iTFcqI2wVN4MGiduENQjCcuoMbkJ/r5VLTIOYndL04TJro5cnxr2puR4nX1+2Svv76K8GaPDhRTDrSFPhgEJ/ZSqpwsX2IX/A=="}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:20.548055 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-6d4b0a1f-902a-4788-80fd-bbcb442ec4f9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'key_pairs'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:46:20.554162 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-6d4b0a1f-902a-4788-80fd-bbcb442ec4f9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for user 4e6b788e0819483580c09902a341ea6d and project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'key_pairs'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:46:20.676134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6d4b0a1f-902a-4788-80fd-bbcb442ec4f9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.798728 Jul 18 08:46:20.684531 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 2/2] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 08:46:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:46:21.339322 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-cc60795e-762e-40f2-92c1-e1f4788b9181 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Action: 'create', calling method: .version_select at 0x7fafbc8eb8b0>, body: {"keypair": {"name": "tempest-keypair-1895949044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbf8wayKPd7hwaWvosVkAIUjmFerzkBcTQTB9JVZNyqDgnQxZzVuePysNZ2Fo9u7u26zMn3KHeEheR8ub/TA61rToD1p1SrEIW/EdiKEwIQTAj9P+gOOiYegh04LA/orw=="}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:21.392461 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-cc60795e-762e-40f2-92c1-e1f4788b9181 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Getting quotas for project d7367af701b84358a4e5c5d0db473b44. Resources: {'key_pairs'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:46:21.411607 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-cc60795e-762e-40f2-92c1-e1f4788b9181 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Getting quotas for user 94eed85a730b46dcb1cf694a3ebf2d3a and project d7367af701b84358a4e5c5d0db473b44. Resources: {'key_pairs'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:46:21.599409 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-cc60795e-762e-40f2-92c1-e1f4788b9181 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.913989 Jul 18 08:46:21.612777 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 3/3] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 08:46:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:46:22.846842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:46:22.847662 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:46:22.848571 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:46:22.849305 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:46:22.850552 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:46:22.878478 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-783848232", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:22.949835 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:22.958528 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:22.963865 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:22.966435 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:23.113657 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Getting quotas for project 4a773b75a4b4442ca01dc2b0d9e4e5d9. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:46:23.131843 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Getting quotas for user 67a5cc6144c0434b9f16fb050c4c7662 and project 4a773b75a4b4442ca01dc2b0d9e4e5d9. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:46:23.204755 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:46:23.216793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:46:23.676042 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7f4a6e90-b661-409b-931a-3ebb0568eb33 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.387711 Jul 18 08:46:23.680510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 1/4] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:46:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 8395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:46:23.705860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-649eb218-2bc5-403e-a069-7d450aec6319 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:23.711044 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-649eb218-2bc5-403e-a069-7d450aec6319 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:23.925635 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-649eb218-2bc5-403e-a069-7d450aec6319 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:23.968792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-649eb218-2bc5-403e-a069-7d450aec6319 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1215 microversion: 2.1 time: 0.273738 Jul 18 08:46:23.979120 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 2/5] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:23 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1215 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:24.592848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.network.neutron [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] validate_networks() for [('7493bcf7-a4b9-4c49-a680-3a0a798b3b98', None, None, None, None, None)] {{(pid=124894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:46:24.995488 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2ba8479e-2bb9-4e74-b446-901dcb1c3a6e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:25.000407 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2ba8479e-2bb9-4e74-b446-901dcb1c3a6e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:25.441893 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2ba8479e-2bb9-4e74-b446-901dcb1c3a6e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:25.451236 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2ba8479e-2bb9-4e74-b446-901dcb1c3a6e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1215 microversion: 2.1 time: 0.459149 Jul 18 08:46:25.452140 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 3/6] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:24 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1215 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:46:26.487840 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-906d0e8b-53c5-4c0d-9ebc-9157a1af717e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:26.490151 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-906d0e8b-53c5-4c0d-9ebc-9157a1af717e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:26.655110 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-906d0e8b-53c5-4c0d-9ebc-9157a1af717e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:26.704293 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-906d0e8b-53c5-4c0d-9ebc-9157a1af717e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1215 microversion: 2.1 time: 0.220472 Jul 18 08:46:26.705339 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:26 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1215 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:27.731175 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3282c9c2-5260-405a-90df-3b8556f59bd2 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:27.733796 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3282c9c2-5260-405a-90df-3b8556f59bd2 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:27.754627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3282c9c2-5260-405a-90df-3b8556f59bd2 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:27.755238 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3282c9c2-5260-405a-90df-3b8556f59bd2 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:27.756293 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3282c9c2-5260-405a-90df-3b8556f59bd2 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:27.757057 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3282c9c2-5260-405a-90df-3b8556f59bd2 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:28.160271 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3282c9c2-5260-405a-90df-3b8556f59bd2 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:28.222048 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3282c9c2-5260-405a-90df-3b8556f59bd2 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1219 microversion: 2.1 time: 0.495207 Jul 18 08:46:28.223420 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:27 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1219 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:46:28.375127 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Flavor limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:46:28.375933 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Image limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:46:28.376733 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Flavor pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:46:28.378208 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Image pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:46:28.378407 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:46:28.396824 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:28.397868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:28.398943 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:28.399782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:28.441745 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Getting quotas for project c2f44b51cc624637bccd9ed1d3b1a769. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:46:28.448099 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Getting quotas for user 56b3d8d145d94b358c86345eb5c3b306 and project c2f44b51cc624637bccd9ed1d3b1a769. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:46:28.470985 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Going to run 1 instances... {{(pid=124894) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:46:28.475928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:46:28.572529 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2147296068", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0fa8b1e-26fd-4098-8362-a39708ae2c08"}], "security_groups": [{"name": "tempest-securitygroup--674113590"}], "key_name": "tempest-keypair-1424650667", "user_data": "}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:28.785919 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7c296439-ac3f-49b2-a59e-ebe9f1f08a0a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.643032 Jul 18 08:46:28.799272 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 4/9] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:46:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 6659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 08:46:28.822714 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c9745587-83db-47f6-a24a-e16ed9debd27 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:28.824296 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c9745587-83db-47f6-a24a-e16ed9debd27 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:29.099281 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] validate_networks() for [('b0fa8b1e-26fd-4098-8362-a39708ae2c08', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:46:29.172225 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c9745587-83db-47f6-a24a-e16ed9debd27 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:29.219884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c9745587-83db-47f6-a24a-e16ed9debd27 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1221 microversion: 2.1 time: 0.417962 Jul 18 08:46:29.235264 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 5/10] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:28 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1221 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:29.240391 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-71ea9a06-9689-434d-ae16-523232212210 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:29.241055 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-71ea9a06-9689-434d-ae16-523232212210 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:29.259314 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71ea9a06-9689-434d-ae16-523232212210 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:29.260077 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71ea9a06-9689-434d-ae16-523232212210 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:29.261898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71ea9a06-9689-434d-ae16-523232212210 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:29.263167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71ea9a06-9689-434d-ae16-523232212210 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:29.993967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-71ea9a06-9689-434d-ae16-523232212210 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:30.080134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-71ea9a06-9689-434d-ae16-523232212210 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1267 microversion: 2.1 time: 0.841081 Jul 18 08:46:30.083243 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 6/11] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:29 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1267 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:46:30.116176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-476256491", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:30.245412 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:46:30.245997 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:46:30.246320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:46:30.250226 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.network.neutron [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] validate_networks() for [('7493bcf7-a4b9-4c49-a680-3a0a798b3b98', None, None, None, None, None)] {{(pid=124894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:46:30.250380 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:46:30.250380 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:46:30.265304 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:30.265774 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:30.266621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:30.267220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:30.299088 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Getting quotas for project ef2947427ce24f46baad0172db285cc8. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:46:30.311989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Getting quotas for user 88b4bd52ede644f0aac8dff94e09dd7d and project ef2947427ce24f46baad0172db285cc8. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:46:30.360931 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:46:30.363912 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:46:30.600443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-756ec398-3510-423e-8434-25e95ecd6cee tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.021406 Jul 18 08:46:30.610376 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 6/12] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 08:46:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 08:46:30.671561 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-244436573", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d509bc50-58ee-41ee-9bed-bf209325abb8"}], "security_groups": [{"name": "tempest-securitygroup--1788395600"}], "key_name": "tempest-keypair-1895949044", "user_data": "}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:31.210752 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] validate_networks() for [('d509bc50-58ee-41ee-9bed-bf209325abb8', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:46:32.332243 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Flavor limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:46:32.332800 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Image limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:46:32.333457 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Flavor pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:46:32.333997 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Image pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:46:32.334544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:46:32.353041 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:32.360782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:32.360782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:32.360782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:32.399351 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Getting quotas for project c2f44b51cc624637bccd9ed1d3b1a769. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:46:32.411197 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Getting quotas for user 56b3d8d145d94b358c86345eb5c3b306 and project c2f44b51cc624637bccd9ed1d3b1a769. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:46:32.447028 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Going to run 1 instances... {{(pid=124894) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:46:32.452845 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:46:32.610809 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:46:32.612102 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:46:32.612756 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:46:32.613326 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:46:32.613894 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:46:32.811122 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:32.811122 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:32.811122 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:32.811122 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:32.812528 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Getting quotas for project d7367af701b84358a4e5c5d0db473b44. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:46:32.812528 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Getting quotas for user 94eed85a730b46dcb1cf694a3ebf2d3a and project d7367af701b84358a4e5c5d0db473b44. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:46:32.812528 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:46:32.812528 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:46:33.145635 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-eb04cb42-aaf7-4995-a3fb-d3f5fbce84e7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.060847 Jul 18 08:46:33.146320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a56ae324-f296-4bb3-a3fa-4b812dcd9fe1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.514472 Jul 18 08:46:33.152988 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 7/13] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:46:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:46:33.161659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 7/14] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:46:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 3076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:46:33.186786 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4a2164fc-19e6-4700-b933-1468da85c4bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:33.204201 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-98a16286-a9c2-4e07-9129-5b903c8b4411 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:33.207758 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-98a16286-a9c2-4e07-9129-5b903c8b4411 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:33.208156 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-4a2164fc-19e6-4700-b933-1468da85c4bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:33.306883 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-98a16286-a9c2-4e07-9129-5b903c8b4411 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:33.307208 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-98a16286-a9c2-4e07-9129-5b903c8b4411 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:33.308072 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-98a16286-a9c2-4e07-9129-5b903c8b4411 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:33.308526 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-98a16286-a9c2-4e07-9129-5b903c8b4411 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:33.671508 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4a2164fc-19e6-4700-b933-1468da85c4bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:33.699922 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4a2164fc-19e6-4700-b933-1468da85c4bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:33.713204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4a2164fc-19e6-4700-b933-1468da85c4bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:33.721643 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-4a2164fc-19e6-4700-b933-1468da85c4bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1282 microversion: 2.20 time: 0.566687 Jul 18 08:46:33.740122 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 8/15] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:33 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1282 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:33.776298 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-567789614", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91d2b33d-7b11-4b88-9cd3-44537bfe048d"}], "security_groups": [{"name": "tempest-securitygroup--276984636"}], "key_name": "tempest-keypair-487120895", "user_data": "}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:34.263628 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-98a16286-a9c2-4e07-9129-5b903c8b4411 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:34.282081 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-98a16286-a9c2-4e07-9129-5b903c8b4411 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1273 microversion: 2.1 time: 1.118046 Jul 18 08:46:34.298422 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:33 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1273 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:34.321230 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3c9a06c9-1c79-4987-b2cc-207f4087d8e4 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:34.327891 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-3c9a06c9-1c79-4987-b2cc-207f4087d8e4 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:34.390744 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] validate_networks() for [('91d2b33d-7b11-4b88-9cd3-44537bfe048d', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:46:34.975206 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-3c9a06c9-1c79-4987-b2cc-207f4087d8e4 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:34.991508 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-3c9a06c9-1c79-4987-b2cc-207f4087d8e4 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1237 microversion: 2.1 time: 0.688200 Jul 18 08:46:35.003738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 9/17] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:34 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1237 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:35.019144 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-63bb6d01-8335-4d0f-bf58-7425a8818980 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:35.036902 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-63bb6d01-8335-4d0f-bf58-7425a8818980 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:35.281502 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-63bb6d01-8335-4d0f-bf58-7425a8818980 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:35.322254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-63bb6d01-8335-4d0f-bf58-7425a8818980 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1221 microversion: 2.1 time: 0.313088 Jul 18 08:46:35.332777 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 10/18] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:35 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1221 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:35.353753 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e493d486-7127-4723-971b-737516416df4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:35.359162 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e493d486-7127-4723-971b-737516416df4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:35.395361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e493d486-7127-4723-971b-737516416df4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:35.398430 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e493d486-7127-4723-971b-737516416df4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:35.406793 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e493d486-7127-4723-971b-737516416df4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:35.410066 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e493d486-7127-4723-971b-737516416df4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:35.605667 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e493d486-7127-4723-971b-737516416df4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:35.626893 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e493d486-7127-4723-971b-737516416df4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:35.635346 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e493d486-7127-4723-971b-737516416df4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:35.652777 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e493d486-7127-4723-971b-737516416df4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1278 microversion: 2.20 time: 0.316921 Jul 18 08:46:35.664105 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 11/19] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:35 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1278 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:35.674836 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5233b19a-a4b1-4402-b605-3d59433b0d73 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:35.675044 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5233b19a-a4b1-4402-b605-3d59433b0d73 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:35.693863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5233b19a-a4b1-4402-b605-3d59433b0d73 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:35.696972 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5233b19a-a4b1-4402-b605-3d59433b0d73 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:35.698202 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5233b19a-a4b1-4402-b605-3d59433b0d73 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:35.703714 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5233b19a-a4b1-4402-b605-3d59433b0d73 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:35.952687 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:46:35.953253 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:46:35.953999 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:46:35.954427 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:46:35.954849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:46:35.977416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:35.977967 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:35.978806 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:35.979364 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:36.019181 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:46:36.024793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for user 4e6b788e0819483580c09902a341ea6d and project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:46:36.057131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:46:36.063546 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:46:36.086567 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5233b19a-a4b1-4402-b605-3d59433b0d73 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:36.098763 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5233b19a-a4b1-4402-b605-3d59433b0d73 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 0.433260 Jul 18 08:46:36.109714 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 12/20] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:35 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:36.115260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f407b4fc-c575-476e-b2a2-f569f042519a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:36.120472 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f407b4fc-c575-476e-b2a2-f569f042519a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:36.130067 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f407b4fc-c575-476e-b2a2-f569f042519a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:36.131163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f407b4fc-c575-476e-b2a2-f569f042519a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:36.132430 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f407b4fc-c575-476e-b2a2-f569f042519a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:36.133145 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f407b4fc-c575-476e-b2a2-f569f042519a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:36.305404 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-92cf051e-2388-496c-959a-fdcaac0f4b9d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.563441 Jul 18 08:46:36.306934 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 9/21] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:46:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 2566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:46:36.319149 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7195c7f5-528e-41dd-8b3e-54113f154f32 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:36.320090 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7195c7f5-528e-41dd-8b3e-54113f154f32 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:36.389942 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f407b4fc-c575-476e-b2a2-f569f042519a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:36.432951 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7195c7f5-528e-41dd-8b3e-54113f154f32 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:36.469345 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7195c7f5-528e-41dd-8b3e-54113f154f32 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1240 microversion: 2.1 time: 0.135712 Jul 18 08:46:36.469345 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 10/22] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:36 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1240 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:36.469728 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f407b4fc-c575-476e-b2a2-f569f042519a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1241 microversion: 2.1 time: 0.343630 Jul 18 08:46:36.479808 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 13/23] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:36 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1241 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:36.482990 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-797e5f43-7926-4ecd-8522-6bb07f5671ec tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:36.483963 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-797e5f43-7926-4ecd-8522-6bb07f5671ec tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:36.491786 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-797e5f43-7926-4ecd-8522-6bb07f5671ec tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:36.492803 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-797e5f43-7926-4ecd-8522-6bb07f5671ec tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:36.494917 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-797e5f43-7926-4ecd-8522-6bb07f5671ec tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:36.495908 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-797e5f43-7926-4ecd-8522-6bb07f5671ec tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:36.595515 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-797e5f43-7926-4ecd-8522-6bb07f5671ec tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:36.609404 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-797e5f43-7926-4ecd-8522-6bb07f5671ec tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1225 microversion: 2.1 time: 0.148829 Jul 18 08:46:36.611163 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 11/24] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:36 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:36.712818 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6dad55ec-ff6d-4f57-b036-fed712bc5b96 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:36.714318 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6dad55ec-ff6d-4f57-b036-fed712bc5b96 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:36.736393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6dad55ec-ff6d-4f57-b036-fed712bc5b96 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:36.737161 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6dad55ec-ff6d-4f57-b036-fed712bc5b96 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:36.738987 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6dad55ec-ff6d-4f57-b036-fed712bc5b96 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:36.740061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6dad55ec-ff6d-4f57-b036-fed712bc5b96 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:36.885595 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6dad55ec-ff6d-4f57-b036-fed712bc5b96 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:36.896366 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6dad55ec-ff6d-4f57-b036-fed712bc5b96 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:36.898263 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6dad55ec-ff6d-4f57-b036-fed712bc5b96 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:36.899521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6dad55ec-ff6d-4f57-b036-fed712bc5b96 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1278 microversion: 2.20 time: 0.204304 Jul 18 08:46:36.913879 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 14/25] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:36 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:37.118097 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9279955d-523f-4192-97c7-9e2b79edc695 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:37.118749 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9279955d-523f-4192-97c7-9e2b79edc695 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:37.134103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9279955d-523f-4192-97c7-9e2b79edc695 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:37.139068 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9279955d-523f-4192-97c7-9e2b79edc695 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:37.140936 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9279955d-523f-4192-97c7-9e2b79edc695 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:37.141676 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9279955d-523f-4192-97c7-9e2b79edc695 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:37.478863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-87725547-4680-4e92-bffe-d04d14f69ba7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:37.483808 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-87725547-4680-4e92-bffe-d04d14f69ba7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:37.505687 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-87725547-4680-4e92-bffe-d04d14f69ba7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:37.506155 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-87725547-4680-4e92-bffe-d04d14f69ba7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:37.506977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-87725547-4680-4e92-bffe-d04d14f69ba7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:37.507423 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-87725547-4680-4e92-bffe-d04d14f69ba7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:37.516269 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9279955d-523f-4192-97c7-9e2b79edc695 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:37.531360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9279955d-523f-4192-97c7-9e2b79edc695 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 0.418182 Jul 18 08:46:37.532374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 12/26] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:37 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:37.547757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2aa4f785-cabc-4c84-97c9-6d60666e67dd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:37.550981 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2aa4f785-cabc-4c84-97c9-6d60666e67dd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:37.573487 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:37.723871 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2aa4f785-cabc-4c84-97c9-6d60666e67dd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:37.734716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2aa4f785-cabc-4c84-97c9-6d60666e67dd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1240 microversion: 2.1 time: 0.200746 Jul 18 08:46:37.736985 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 13/27] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:37 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1240 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:37.759719 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0280a0ce-49a0-425e-bb56-41b049cae7da tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:37.761694 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0280a0ce-49a0-425e-bb56-41b049cae7da tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:37.787056 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0280a0ce-49a0-425e-bb56-41b049cae7da tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:37.787486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0280a0ce-49a0-425e-bb56-41b049cae7da tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:37.788407 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0280a0ce-49a0-425e-bb56-41b049cae7da tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:37.788859 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0280a0ce-49a0-425e-bb56-41b049cae7da tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:37.813049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-87725547-4680-4e92-bffe-d04d14f69ba7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:37.870614 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-87725547-4680-4e92-bffe-d04d14f69ba7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1241 microversion: 2.1 time: 0.395639 Jul 18 08:46:37.871250 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 15/28] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:37 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1241 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:46:37.922333 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c3588b67-b127-4204-9329-a10d5995634a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:37.923033 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c3588b67-b127-4204-9329-a10d5995634a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:37.946351 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c3588b67-b127-4204-9329-a10d5995634a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:37.947534 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c3588b67-b127-4204-9329-a10d5995634a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:37.955219 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c3588b67-b127-4204-9329-a10d5995634a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:37.955219 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c3588b67-b127-4204-9329-a10d5995634a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:38.045371 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0280a0ce-49a0-425e-bb56-41b049cae7da tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:38.101578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0280a0ce-49a0-425e-bb56-41b049cae7da tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1225 microversion: 2.1 time: 0.360700 Jul 18 08:46:38.124508 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 14/29] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:37 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1225 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:38.573874 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5f0cd169-619d-43b0-8bb5-4f1b23e0f244 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:38.576119 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5f0cd169-619d-43b0-8bb5-4f1b23e0f244 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:38.624779 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5f0cd169-619d-43b0-8bb5-4f1b23e0f244 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:38.626353 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5f0cd169-619d-43b0-8bb5-4f1b23e0f244 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:38.628582 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5f0cd169-619d-43b0-8bb5-4f1b23e0f244 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:38.630050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5f0cd169-619d-43b0-8bb5-4f1b23e0f244 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:38.781342 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c3588b67-b127-4204-9329-a10d5995634a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:38.820905 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c3588b67-b127-4204-9329-a10d5995634a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:38.830310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c3588b67-b127-4204-9329-a10d5995634a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:38.850516 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c3588b67-b127-4204-9329-a10d5995634a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1278 microversion: 2.20 time: 0.933186 Jul 18 08:46:38.872608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 16/30] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:37 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1278 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:38.888607 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-cc6fa0d1-ead8-4140-b800-3509ac3704f2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:38.904576 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-cc6fa0d1-ead8-4140-b800-3509ac3704f2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:38.925678 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:39.079033 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-cc6fa0d1-ead8-4140-b800-3509ac3704f2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:39.090500 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-cc6fa0d1-ead8-4140-b800-3509ac3704f2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1240 microversion: 2.1 time: 0.214402 Jul 18 08:46:39.092032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 17/31] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:38 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1240 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:39.097294 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b4a7e7cb-ecdb-4809-974c-2bcf8b52cfbc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:39.115968 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b4a7e7cb-ecdb-4809-974c-2bcf8b52cfbc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:39.124035 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b4a7e7cb-ecdb-4809-974c-2bcf8b52cfbc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:39.124862 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b4a7e7cb-ecdb-4809-974c-2bcf8b52cfbc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:39.125915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b4a7e7cb-ecdb-4809-974c-2bcf8b52cfbc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:39.126705 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b4a7e7cb-ecdb-4809-974c-2bcf8b52cfbc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:39.312971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b4a7e7cb-ecdb-4809-974c-2bcf8b52cfbc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:39.339549 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b4a7e7cb-ecdb-4809-974c-2bcf8b52cfbc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1233 microversion: 2.1 time: 0.239842 Jul 18 08:46:39.340282 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 18/32] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:39 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1233 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:39.368350 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5f0cd169-619d-43b0-8bb5-4f1b23e0f244 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:39.373505 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-fc9d4539-3bd0-46d3-be65-1d59bf9b03a5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:39.374369 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-fc9d4539-3bd0-46d3-be65-1d59bf9b03a5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:39.379799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5f0cd169-619d-43b0-8bb5-4f1b23e0f244 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 0.831234 Jul 18 08:46:39.380406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 15/33] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:38 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:39.398429 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fc9d4539-3bd0-46d3-be65-1d59bf9b03a5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:39.402305 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fc9d4539-3bd0-46d3-be65-1d59bf9b03a5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:39.402305 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fc9d4539-3bd0-46d3-be65-1d59bf9b03a5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:39.402305 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fc9d4539-3bd0-46d3-be65-1d59bf9b03a5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:39.686191 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-fc9d4539-3bd0-46d3-be65-1d59bf9b03a5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:39.707028 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-fc9d4539-3bd0-46d3-be65-1d59bf9b03a5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1217 microversion: 2.1 time: 0.352660 Jul 18 08:46:39.707795 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 19/34] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:39 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1217 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:39.895490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-59d1f25b-669a-4b26-89e0-4a2d0ca0dbc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:39.896278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-59d1f25b-669a-4b26-89e0-4a2d0ca0dbc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:39.907380 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-59d1f25b-669a-4b26-89e0-4a2d0ca0dbc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:39.908421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-59d1f25b-669a-4b26-89e0-4a2d0ca0dbc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:39.909671 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-59d1f25b-669a-4b26-89e0-4a2d0ca0dbc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:39.910883 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-59d1f25b-669a-4b26-89e0-4a2d0ca0dbc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:40.035217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-59d1f25b-669a-4b26-89e0-4a2d0ca0dbc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:40.049338 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-59d1f25b-669a-4b26-89e0-4a2d0ca0dbc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:40.051575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-59d1f25b-669a-4b26-89e0-4a2d0ca0dbc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:40.053549 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-59d1f25b-669a-4b26-89e0-4a2d0ca0dbc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1334 microversion: 2.20 time: 0.166415 Jul 18 08:46:40.054987 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 16/35] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:39 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1334 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:40.110995 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5505b00e-e000-4cce-886f-7e7d2f2071eb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:40.112457 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5505b00e-e000-4cce-886f-7e7d2f2071eb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:40.123858 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5505b00e-e000-4cce-886f-7e7d2f2071eb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:40.136230 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5505b00e-e000-4cce-886f-7e7d2f2071eb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:40.145267 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5505b00e-e000-4cce-886f-7e7d2f2071eb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:40.146039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5505b00e-e000-4cce-886f-7e7d2f2071eb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:40.361151 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6a711662-499c-4791-a5bc-07baad574fe6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:40.362485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-6a711662-499c-4791-a5bc-07baad574fe6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:40.425134 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6a711662-499c-4791-a5bc-07baad574fe6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:40.425134 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6a711662-499c-4791-a5bc-07baad574fe6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:40.426549 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6a711662-499c-4791-a5bc-07baad574fe6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:40.428067 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6a711662-499c-4791-a5bc-07baad574fe6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:40.557651 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6a711662-499c-4791-a5bc-07baad574fe6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:40.608475 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-6a711662-499c-4791-a5bc-07baad574fe6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1289 microversion: 2.1 time: 0.253509 Jul 18 08:46:40.613393 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 17/36] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:40 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1289 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:46:40.638106 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c52f6641-56a4-496f-8ad8-55506603a51b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:40.640354 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c52f6641-56a4-496f-8ad8-55506603a51b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:40.657067 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5505b00e-e000-4cce-886f-7e7d2f2071eb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:40.666636 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c52f6641-56a4-496f-8ad8-55506603a51b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:40.668484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c52f6641-56a4-496f-8ad8-55506603a51b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:40.672113 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c52f6641-56a4-496f-8ad8-55506603a51b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:40.673021 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5505b00e-e000-4cce-886f-7e7d2f2071eb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1236 microversion: 2.1 time: 0.567400 Jul 18 08:46:40.673367 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c52f6641-56a4-496f-8ad8-55506603a51b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:40.673890 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 20/37] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:40 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1236 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:46:40.728601 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8dd66568-8397-4c9e-a64a-dd06ba8e7899 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:40.730695 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8dd66568-8397-4c9e-a64a-dd06ba8e7899 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:40.740462 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8dd66568-8397-4c9e-a64a-dd06ba8e7899 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:40.740922 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8dd66568-8397-4c9e-a64a-dd06ba8e7899 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:40.741728 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8dd66568-8397-4c9e-a64a-dd06ba8e7899 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:40.742298 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8dd66568-8397-4c9e-a64a-dd06ba8e7899 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:40.860889 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8dd66568-8397-4c9e-a64a-dd06ba8e7899 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:40.879602 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8dd66568-8397-4c9e-a64a-dd06ba8e7899 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1273 microversion: 2.1 time: 0.156677 Jul 18 08:46:40.883388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 21/38] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:40 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:41.078964 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ea48def0-ba6b-43dc-8f76-df798b5aeddd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:41.079595 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ea48def0-ba6b-43dc-8f76-df798b5aeddd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:41.094639 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ea48def0-ba6b-43dc-8f76-df798b5aeddd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:41.094639 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ea48def0-ba6b-43dc-8f76-df798b5aeddd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:41.100107 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ea48def0-ba6b-43dc-8f76-df798b5aeddd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:41.100849 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ea48def0-ba6b-43dc-8f76-df798b5aeddd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:41.164750 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c52f6641-56a4-496f-8ad8-55506603a51b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:41.190002 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c52f6641-56a4-496f-8ad8-55506603a51b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 0.572190 Jul 18 08:46:41.204631 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 18/39] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:40 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:41.631483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-39c6ba5f-f56e-4941-b032-ed8939189217 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:41.633020 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-39c6ba5f-f56e-4941-b032-ed8939189217 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:41.644450 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-39c6ba5f-f56e-4941-b032-ed8939189217 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:41.647353 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-39c6ba5f-f56e-4941-b032-ed8939189217 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:41.648492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-39c6ba5f-f56e-4941-b032-ed8939189217 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:41.656575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-39c6ba5f-f56e-4941-b032-ed8939189217 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:41.699726 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ea48def0-ba6b-43dc-8f76-df798b5aeddd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:41.736561 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ea48def0-ba6b-43dc-8f76-df798b5aeddd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:41.746839 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ea48def0-ba6b-43dc-8f76-df798b5aeddd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:41.752790 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ea48def0-ba6b-43dc-8f76-df798b5aeddd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1342 microversion: 2.20 time: 0.677821 Jul 18 08:46:41.759578 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 22/40] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:41 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1342 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:41.807648 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-89477d5e-d43e-4cfd-a523-052a9cba8ea4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:41.818627 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-89477d5e-d43e-4cfd-a523-052a9cba8ea4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:41.890278 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-89477d5e-d43e-4cfd-a523-052a9cba8ea4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:41.893510 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-89477d5e-d43e-4cfd-a523-052a9cba8ea4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:41.897975 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-89477d5e-d43e-4cfd-a523-052a9cba8ea4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:41.900572 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-89477d5e-d43e-4cfd-a523-052a9cba8ea4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:42.221381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-89477d5e-d43e-4cfd-a523-052a9cba8ea4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:42.256311 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-89477d5e-d43e-4cfd-a523-052a9cba8ea4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1292 microversion: 2.1 time: 0.493666 Jul 18 08:46:42.270121 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 23/41] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:41 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1292 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:42.285593 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-af7f1a7b-b1b6-4b6e-ab4a-b92a41709f55 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:42.286760 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-af7f1a7b-b1b6-4b6e-ab4a-b92a41709f55 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:42.331456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af7f1a7b-b1b6-4b6e-ab4a-b92a41709f55 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:42.335030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af7f1a7b-b1b6-4b6e-ab4a-b92a41709f55 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:42.335030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af7f1a7b-b1b6-4b6e-ab4a-b92a41709f55 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:42.335030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af7f1a7b-b1b6-4b6e-ab4a-b92a41709f55 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:42.394307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=4 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:42.415081 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-39c6ba5f-f56e-4941-b032-ed8939189217 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:42.493849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-39c6ba5f-f56e-4941-b032-ed8939189217 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1297 microversion: 2.1 time: 0.866638 Jul 18 08:46:42.513850 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 19/42] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:41 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1297 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:46:42.532913 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-59e4d895-e415-49bf-be66-fbb6f8cc5d5e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:42.538923 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-59e4d895-e415-49bf-be66-fbb6f8cc5d5e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:42.595298 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-59e4d895-e415-49bf-be66-fbb6f8cc5d5e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:42.601878 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-59e4d895-e415-49bf-be66-fbb6f8cc5d5e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:42.609258 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-59e4d895-e415-49bf-be66-fbb6f8cc5d5e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:42.613783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-59e4d895-e415-49bf-be66-fbb6f8cc5d5e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:43.127804 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-af7f1a7b-b1b6-4b6e-ab4a-b92a41709f55 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:43.179470 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-af7f1a7b-b1b6-4b6e-ab4a-b92a41709f55 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1281 microversion: 2.1 time: 0.901168 Jul 18 08:46:43.183809 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 24/43] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:42 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1281 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:43.192169 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7ce153d7-7311-4b64-a470-32cc4c5a6d78 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:43.197657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7ce153d7-7311-4b64-a470-32cc4c5a6d78 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:43.230258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7ce153d7-7311-4b64-a470-32cc4c5a6d78 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:43.230258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7ce153d7-7311-4b64-a470-32cc4c5a6d78 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:43.234927 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7ce153d7-7311-4b64-a470-32cc4c5a6d78 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:43.236782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7ce153d7-7311-4b64-a470-32cc4c5a6d78 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:43.873662 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-59e4d895-e415-49bf-be66-fbb6f8cc5d5e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:43.906668 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-59e4d895-e415-49bf-be66-fbb6f8cc5d5e tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 1.390105 Jul 18 08:46:43.907819 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 20/44] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:42 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:43.921072 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8cfa032b-c119-4da6-9540-f8df7a12d32d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:43.922237 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8cfa032b-c119-4da6-9540-f8df7a12d32d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:43.936062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cfa032b-c119-4da6-9540-f8df7a12d32d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:43.937877 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cfa032b-c119-4da6-9540-f8df7a12d32d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:43.939601 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cfa032b-c119-4da6-9540-f8df7a12d32d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:43.940551 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cfa032b-c119-4da6-9540-f8df7a12d32d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:44.165548 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7ce153d7-7311-4b64-a470-32cc4c5a6d78 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:44.174520 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=100 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:44.216032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7ce153d7-7311-4b64-a470-32cc4c5a6d78 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:44.239414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7ce153d7-7311-4b64-a470-32cc4c5a6d78 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:44.250065 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7ce153d7-7311-4b64-a470-32cc4c5a6d78 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1340 microversion: 2.20 time: 1.057738 Jul 18 08:46:44.262390 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-8cfa032b-c119-4da6-9540-f8df7a12d32d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:44.266431 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 25/45] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:43 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1340 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:44.282883 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3add8faa-b3da-4fcb-9ecc-e8f43db975b3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:44.307868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-3add8faa-b3da-4fcb-9ecc-e8f43db975b3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:44.308079 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8cfa032b-c119-4da6-9540-f8df7a12d32d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1298 microversion: 2.1 time: 0.379709 Jul 18 08:46:44.308079 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 21/46] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:43 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1298 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:44.331197 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3add8faa-b3da-4fcb-9ecc-e8f43db975b3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:44.355220 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3add8faa-b3da-4fcb-9ecc-e8f43db975b3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:44.359063 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3add8faa-b3da-4fcb-9ecc-e8f43db975b3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:44.375212 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3add8faa-b3da-4fcb-9ecc-e8f43db975b3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:44.511219 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-88dae711-d245-4d69-9be2-f0e88eab818f req-0053a906-0556-443e-9b43-abbee4a93395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9efda553-6895-4088-a371-4c3d6fb05969", "tag": "b8385ec2-63dc-4baa-baa7-44b6b21c02d5"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:44.534848 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-88dae711-d245-4d69-9be2-f0e88eab818f req-0053a906-0556-443e-9b43-abbee4a93395 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:44.535359 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-88dae711-d245-4d69-9be2-f0e88eab818f req-0053a906-0556-443e-9b43-abbee4a93395 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:44.566481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-88dae711-d245-4d69-9be2-f0e88eab818f req-0053a906-0556-443e-9b43-abbee4a93395 service nova] Creating event network-changed:b8385ec2-63dc-4baa-baa7-44b6b21c02d5 for instance 9efda553-6895-4088-a371-4c3d6fb05969 on hv-cinder-85014 Jul 18 08:46:44.567788 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-88dae711-d245-4d69-9be2-f0e88eab818f req-0053a906-0556-443e-9b43-abbee4a93395 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124895) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 08:46:44.569585 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c0afbfc8-d177-4f87-89c7-9be0c442353a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:44.571453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c0afbfc8-d177-4f87-89c7-9be0c442353a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:44.573406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c0afbfc8-d177-4f87-89c7-9be0c442353a None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:44.574140 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c0afbfc8-d177-4f87-89c7-9be0c442353a None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:44.590234 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.compute.rpcapi [None req-c0afbfc8-d177-4f87-89c7-9be0c442353a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 08:46:44.592686 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c0afbfc8-d177-4f87-89c7-9be0c442353a None None] Releasing lock "compute-rpcapi-router" {{(pid=124895) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 08:46:44.646031 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c0afbfc8-d177-4f87-89c7-9be0c442353a None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.351493 Jul 18 08:46:44.647321 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 22/47] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:46:44.675195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-45b63e30-76cf-47cb-a930-5591c1a716b1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:44.676604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-45b63e30-76cf-47cb-a930-5591c1a716b1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:44.707892 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-45b63e30-76cf-47cb-a930-5591c1a716b1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:44.708987 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-45b63e30-76cf-47cb-a930-5591c1a716b1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:44.710507 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-45b63e30-76cf-47cb-a930-5591c1a716b1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:44.711243 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-45b63e30-76cf-47cb-a930-5591c1a716b1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:44.896639 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-3add8faa-b3da-4fcb-9ecc-e8f43db975b3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:44.924997 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-3add8faa-b3da-4fcb-9ecc-e8f43db975b3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1295 microversion: 2.1 time: 0.653972 Jul 18 08:46:44.926043 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 26/48] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:44 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1295 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:44.955453 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f2705603-fd31-4297-ad8e-706f525e0b65 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:44.959076 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f2705603-fd31-4297-ad8e-706f525e0b65 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:44.989257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f2705603-fd31-4297-ad8e-706f525e0b65 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:44.990406 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f2705603-fd31-4297-ad8e-706f525e0b65 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:44.991831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f2705603-fd31-4297-ad8e-706f525e0b65 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:44.992689 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f2705603-fd31-4297-ad8e-706f525e0b65 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:45.195381 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-45b63e30-76cf-47cb-a930-5591c1a716b1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:45.238037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-45b63e30-76cf-47cb-a930-5591c1a716b1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1279 microversion: 2.1 time: 0.586588 Jul 18 08:46:45.241457 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 23/49] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:44 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1279 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:45.304781 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-48b3cbc8-964d-4e82-99e8-8914c09fed6c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:45.308999 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-48b3cbc8-964d-4e82-99e8-8914c09fed6c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:45.329391 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-48b3cbc8-964d-4e82-99e8-8914c09fed6c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:45.332551 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-48b3cbc8-964d-4e82-99e8-8914c09fed6c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:45.336490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-48b3cbc8-964d-4e82-99e8-8914c09fed6c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:45.343620 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-48b3cbc8-964d-4e82-99e8-8914c09fed6c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:45.860148 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-48b3cbc8-964d-4e82-99e8-8914c09fed6c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:45.876709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-48b3cbc8-964d-4e82-99e8-8914c09fed6c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:45.878516 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-48b3cbc8-964d-4e82-99e8-8914c09fed6c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:45.879807 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-48b3cbc8-964d-4e82-99e8-8914c09fed6c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1340 microversion: 2.20 time: 0.579333 Jul 18 08:46:45.881449 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 24/50] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:45 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1340 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:46:45.887140 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e82984bc-aee0-4456-99e1-1e1c54d0bd90 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:45.889450 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e82984bc-aee0-4456-99e1-1e1c54d0bd90 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:45.905614 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e82984bc-aee0-4456-99e1-1e1c54d0bd90 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:45.909520 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e82984bc-aee0-4456-99e1-1e1c54d0bd90 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:45.912093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e82984bc-aee0-4456-99e1-1e1c54d0bd90 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:45.915238 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e82984bc-aee0-4456-99e1-1e1c54d0bd90 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:45.960658 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f2705603-fd31-4297-ad8e-706f525e0b65 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:45.962326 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=93 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:45.994404 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f2705603-fd31-4297-ad8e-706f525e0b65 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 1.059228 Jul 18 08:46:45.996017 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 27/51] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:44 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:46.014598 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0689d8aa-908a-418c-b0cd-2c24a8b9ed0d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:46.022049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0689d8aa-908a-418c-b0cd-2c24a8b9ed0d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:46.039922 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0689d8aa-908a-418c-b0cd-2c24a8b9ed0d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:46.045087 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0689d8aa-908a-418c-b0cd-2c24a8b9ed0d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:46.045087 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0689d8aa-908a-418c-b0cd-2c24a8b9ed0d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:46.045087 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0689d8aa-908a-418c-b0cd-2c24a8b9ed0d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:46.215692 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e82984bc-aee0-4456-99e1-1e1c54d0bd90 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:46.241471 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e82984bc-aee0-4456-99e1-1e1c54d0bd90 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1298 microversion: 2.1 time: 0.358119 Jul 18 08:46:46.248411 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 25/52] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:45 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1298 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:46.330017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e9eb61dd-cf5a-4e4c-9891-f85fc4d45cab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:46.331917 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e9eb61dd-cf5a-4e4c-9891-f85fc4d45cab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:46.351920 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9eb61dd-cf5a-4e4c-9891-f85fc4d45cab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:46.351920 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9eb61dd-cf5a-4e4c-9891-f85fc4d45cab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:46.353939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9eb61dd-cf5a-4e4c-9891-f85fc4d45cab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:46.356282 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9eb61dd-cf5a-4e4c-9891-f85fc4d45cab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:46.411337 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0689d8aa-908a-418c-b0cd-2c24a8b9ed0d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:46.436294 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0689d8aa-908a-418c-b0cd-2c24a8b9ed0d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1295 microversion: 2.1 time: 0.436585 Jul 18 08:46:46.441410 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 28/53] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:45 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1295 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:46.731071 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e9eb61dd-cf5a-4e4c-9891-f85fc4d45cab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:46.754350 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e9eb61dd-cf5a-4e4c-9891-f85fc4d45cab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1279 microversion: 2.1 time: 0.440069 Jul 18 08:46:46.773979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 26/54] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:46 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1279 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:46.919120 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-98ff73f4-9110-4ff1-94d7-65912c682e16 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:46.924268 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-98ff73f4-9110-4ff1-94d7-65912c682e16 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:46.955216 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-98ff73f4-9110-4ff1-94d7-65912c682e16 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:46.959051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-98ff73f4-9110-4ff1-94d7-65912c682e16 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:46.959051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-98ff73f4-9110-4ff1-94d7-65912c682e16 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:46.959051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-98ff73f4-9110-4ff1-94d7-65912c682e16 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:47.034319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8db62382-c943-46e9-8593-93f59a1063fe tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:47.035439 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8db62382-c943-46e9-8593-93f59a1063fe tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:47.067326 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8db62382-c943-46e9-8593-93f59a1063fe tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:47.068321 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8db62382-c943-46e9-8593-93f59a1063fe tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:47.069811 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8db62382-c943-46e9-8593-93f59a1063fe tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:47.070998 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8db62382-c943-46e9-8593-93f59a1063fe tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:47.162474 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-98ff73f4-9110-4ff1-94d7-65912c682e16 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:47.191978 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-98ff73f4-9110-4ff1-94d7-65912c682e16 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:47.196039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-98ff73f4-9110-4ff1-94d7-65912c682e16 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:47.198475 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-98ff73f4-9110-4ff1-94d7-65912c682e16 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1340 microversion: 2.20 time: 0.287682 Jul 18 08:46:47.215332 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 29/55] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:46 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1340 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:47.271262 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e7583ea6-9514-43da-9fcc-ffe8058da994 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:47.272214 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e7583ea6-9514-43da-9fcc-ffe8058da994 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:47.300441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7583ea6-9514-43da-9fcc-ffe8058da994 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:47.301378 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7583ea6-9514-43da-9fcc-ffe8058da994 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:47.302496 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7583ea6-9514-43da-9fcc-ffe8058da994 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:47.303168 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7583ea6-9514-43da-9fcc-ffe8058da994 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:47.621535 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e7583ea6-9514-43da-9fcc-ffe8058da994 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:47.639486 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e7583ea6-9514-43da-9fcc-ffe8058da994 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1298 microversion: 2.1 time: 0.370523 Jul 18 08:46:47.665326 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 30/56] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:47 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1298 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:47.705470 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ec68dcb2-db2f-4d2b-b752-91d193e17eac tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:47.713076 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ec68dcb2-db2f-4d2b-b752-91d193e17eac tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:47.731611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=36 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:47.761146 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec68dcb2-db2f-4d2b-b752-91d193e17eac tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:47.763302 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec68dcb2-db2f-4d2b-b752-91d193e17eac tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:47.765089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec68dcb2-db2f-4d2b-b752-91d193e17eac tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:47.768944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec68dcb2-db2f-4d2b-b752-91d193e17eac tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:48.481257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ec68dcb2-db2f-4d2b-b752-91d193e17eac tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:48.494064 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ec68dcb2-db2f-4d2b-b752-91d193e17eac tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1363 microversion: 2.1 time: 0.827076 Jul 18 08:46:48.508445 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 31/57] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:47 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1363 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:48.540187 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-fa139696-be6f-471d-b4ef-5d545062e3f3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:48.542451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-fa139696-be6f-471d-b4ef-5d545062e3f3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:48.576209 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fa139696-be6f-471d-b4ef-5d545062e3f3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:48.580564 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fa139696-be6f-471d-b4ef-5d545062e3f3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:48.583824 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fa139696-be6f-471d-b4ef-5d545062e3f3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:48.589511 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fa139696-be6f-471d-b4ef-5d545062e3f3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:48.766784 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-8db62382-c943-46e9-8593-93f59a1063fe tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:48.779093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8db62382-c943-46e9-8593-93f59a1063fe tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 1.754693 Jul 18 08:46:48.785722 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-fa139696-be6f-471d-b4ef-5d545062e3f3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:48.796436 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 27/58] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:47 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:48.813913 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-fa139696-be6f-471d-b4ef-5d545062e3f3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1279 microversion: 2.1 time: 0.303427 Jul 18 08:46:48.814829 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 32/59] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:48 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1279 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:48.818523 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9803bfa4-066c-47a3-bbb8-149221ad0fbe tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:48.822875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9803bfa4-066c-47a3-bbb8-149221ad0fbe tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:48.828795 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d10d9e8d-cef9-4c5a-a54c-25cce548eceb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:48.835039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d10d9e8d-cef9-4c5a-a54c-25cce548eceb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:48.881914 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9803bfa4-066c-47a3-bbb8-149221ad0fbe tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:48.882740 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d10d9e8d-cef9-4c5a-a54c-25cce548eceb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:48.885293 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9803bfa4-066c-47a3-bbb8-149221ad0fbe tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:48.888878 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d10d9e8d-cef9-4c5a-a54c-25cce548eceb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:48.889063 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9803bfa4-066c-47a3-bbb8-149221ad0fbe tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:48.890039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d10d9e8d-cef9-4c5a-a54c-25cce548eceb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:48.891004 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d10d9e8d-cef9-4c5a-a54c-25cce548eceb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:48.892522 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9803bfa4-066c-47a3-bbb8-149221ad0fbe tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:49.084639 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=32 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:49.931966 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9803bfa4-066c-47a3-bbb8-149221ad0fbe tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:49.944574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9803bfa4-066c-47a3-bbb8-149221ad0fbe tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:49.951402 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9803bfa4-066c-47a3-bbb8-149221ad0fbe tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:49.953020 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9803bfa4-066c-47a3-bbb8-149221ad0fbe tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 1.145802 Jul 18 08:46:49.971943 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 28/60] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:48 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:49.975590 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d10d9e8d-cef9-4c5a-a54c-25cce548eceb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:49.978126 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9fe7e421-5158-47aa-a1d3-1275dbaea76c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:49.979128 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9fe7e421-5158-47aa-a1d3-1275dbaea76c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:49.986764 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9fe7e421-5158-47aa-a1d3-1275dbaea76c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:49.988247 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9fe7e421-5158-47aa-a1d3-1275dbaea76c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:49.989349 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9fe7e421-5158-47aa-a1d3-1275dbaea76c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:49.990031 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9fe7e421-5158-47aa-a1d3-1275dbaea76c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:50.017063 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d10d9e8d-cef9-4c5a-a54c-25cce548eceb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 1.199906 Jul 18 08:46:50.039524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 33/61] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:48 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:50.050715 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1c0ac821-6be8-4692-86cb-6aa0aa6c5459 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:50.052324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1c0ac821-6be8-4692-86cb-6aa0aa6c5459 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:50.072547 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c0ac821-6be8-4692-86cb-6aa0aa6c5459 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:50.073992 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c0ac821-6be8-4692-86cb-6aa0aa6c5459 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:50.077434 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c0ac821-6be8-4692-86cb-6aa0aa6c5459 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:50.079060 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c0ac821-6be8-4692-86cb-6aa0aa6c5459 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:50.526219 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9fe7e421-5158-47aa-a1d3-1275dbaea76c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:50.588520 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9fe7e421-5158-47aa-a1d3-1275dbaea76c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1363 microversion: 2.1 time: 0.610229 Jul 18 08:46:50.592499 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 29/62] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:49 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1363 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:50.609570 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-11aba882-8d6e-49e7-a47d-e99e1bc6c94b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:50.610194 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-11aba882-8d6e-49e7-a47d-e99e1bc6c94b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:50.647563 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-11aba882-8d6e-49e7-a47d-e99e1bc6c94b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:50.648059 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-11aba882-8d6e-49e7-a47d-e99e1bc6c94b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:50.649058 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-11aba882-8d6e-49e7-a47d-e99e1bc6c94b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:50.649673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-11aba882-8d6e-49e7-a47d-e99e1bc6c94b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:50.855198 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1c0ac821-6be8-4692-86cb-6aa0aa6c5459 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:50.868176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1c0ac821-6be8-4692-86cb-6aa0aa6c5459 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 0.826772 Jul 18 08:46:50.879161 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 34/63] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:50 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:50.978172 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9a81e5f6-df75-4ccf-a699-8a8de53fe4bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:50.980492 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9a81e5f6-df75-4ccf-a699-8a8de53fe4bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:50.994660 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a81e5f6-df75-4ccf-a699-8a8de53fe4bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:50.995411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a81e5f6-df75-4ccf-a699-8a8de53fe4bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:50.997000 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a81e5f6-df75-4ccf-a699-8a8de53fe4bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:50.998812 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a81e5f6-df75-4ccf-a699-8a8de53fe4bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:51.551975 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9a81e5f6-df75-4ccf-a699-8a8de53fe4bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:51.569618 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9a81e5f6-df75-4ccf-a699-8a8de53fe4bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:51.571635 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9a81e5f6-df75-4ccf-a699-8a8de53fe4bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:51.573695 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9a81e5f6-df75-4ccf-a699-8a8de53fe4bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.603258 Jul 18 08:46:51.574293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 35/64] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:50 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:51.583818 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b58cdb72-f10d-499d-aea6-a0e34a0cdb1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:51.586814 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b58cdb72-f10d-499d-aea6-a0e34a0cdb1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:51.603067 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b58cdb72-f10d-499d-aea6-a0e34a0cdb1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:51.603764 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b58cdb72-f10d-499d-aea6-a0e34a0cdb1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:51.605867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b58cdb72-f10d-499d-aea6-a0e34a0cdb1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:51.607100 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b58cdb72-f10d-499d-aea6-a0e34a0cdb1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:51.771348 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-11aba882-8d6e-49e7-a47d-e99e1bc6c94b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:51.782893 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-11aba882-8d6e-49e7-a47d-e99e1bc6c94b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 1.177852 Jul 18 08:46:51.796131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 30/65] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:50 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:51.796131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-7a685bdb-ed68-4c7d-808a-e07cd7e73043 req-4726447f-79d6-4f71-8b3d-e30c54bb29ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75cd9ec0-94a9-4043-983e-d876084556ad", "tag": "78901683-090c-493b-919a-d66d30e8239b"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:51.802956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-7a685bdb-ed68-4c7d-808a-e07cd7e73043 req-4726447f-79d6-4f71-8b3d-e30c54bb29ce service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:51.803865 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-7a685bdb-ed68-4c7d-808a-e07cd7e73043 req-4726447f-79d6-4f71-8b3d-e30c54bb29ce service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:51.828464 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-7a685bdb-ed68-4c7d-808a-e07cd7e73043 req-4726447f-79d6-4f71-8b3d-e30c54bb29ce service nova] Creating event network-changed:78901683-090c-493b-919a-d66d30e8239b for instance 75cd9ec0-94a9-4043-983e-d876084556ad on hv-cinder-85014 Jul 18 08:46:51.838408 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-7a685bdb-ed68-4c7d-808a-e07cd7e73043 req-4726447f-79d6-4f71-8b3d-e30c54bb29ce service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052821 Jul 18 08:46:51.840806 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 31/66] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:46:51.849736 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2441bb7c-6f13-4a49-9900-e70d4aee42f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:51.853224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2441bb7c-6f13-4a49-9900-e70d4aee42f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:51.864684 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2441bb7c-6f13-4a49-9900-e70d4aee42f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:51.865752 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2441bb7c-6f13-4a49-9900-e70d4aee42f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:51.866892 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2441bb7c-6f13-4a49-9900-e70d4aee42f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:51.867595 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2441bb7c-6f13-4a49-9900-e70d4aee42f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:51.908000 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b58cdb72-f10d-499d-aea6-a0e34a0cdb1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:51.925634 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b58cdb72-f10d-499d-aea6-a0e34a0cdb1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.349776 Jul 18 08:46:51.927342 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 36/67] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:51 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:51.940830 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8607b9ac-c91e-42a6-b8c1-4026a1e0bb7d tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:51.943100 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8607b9ac-c91e-42a6-b8c1-4026a1e0bb7d tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:51.960376 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8607b9ac-c91e-42a6-b8c1-4026a1e0bb7d tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:51.961340 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8607b9ac-c91e-42a6-b8c1-4026a1e0bb7d tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:51.963352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8607b9ac-c91e-42a6-b8c1-4026a1e0bb7d tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:51.964265 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8607b9ac-c91e-42a6-b8c1-4026a1e0bb7d tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:52.568846 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8607b9ac-c91e-42a6-b8c1-4026a1e0bb7d tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:52.598054 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8607b9ac-c91e-42a6-b8c1-4026a1e0bb7d tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 0.663809 Jul 18 08:46:52.599620 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 37/68] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:51 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:52.609600 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-44d668e5-596c-4400-84c5-09efcb48e16d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:52.610743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-44d668e5-596c-4400-84c5-09efcb48e16d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:52.622608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-44d668e5-596c-4400-84c5-09efcb48e16d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:52.623864 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-44d668e5-596c-4400-84c5-09efcb48e16d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:52.625596 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-44d668e5-596c-4400-84c5-09efcb48e16d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:52.626830 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-44d668e5-596c-4400-84c5-09efcb48e16d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:52.720684 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2441bb7c-6f13-4a49-9900-e70d4aee42f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:52.737937 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2441bb7c-6f13-4a49-9900-e70d4aee42f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1363 microversion: 2.1 time: 0.894484 Jul 18 08:46:52.765977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 32/69] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:51 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1363 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:52.827751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-44d668e5-596c-4400-84c5-09efcb48e16d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:52.841661 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f2dc3af4-7f82-4b12-bfda-bafb0277b2a8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:52.843201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f2dc3af4-7f82-4b12-bfda-bafb0277b2a8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:52.861772 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-44d668e5-596c-4400-84c5-09efcb48e16d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:52.863192 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f2dc3af4-7f82-4b12-bfda-bafb0277b2a8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:52.864103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f2dc3af4-7f82-4b12-bfda-bafb0277b2a8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:52.864673 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-44d668e5-596c-4400-84c5-09efcb48e16d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:52.865652 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f2dc3af4-7f82-4b12-bfda-bafb0277b2a8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:52.866465 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f2dc3af4-7f82-4b12-bfda-bafb0277b2a8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:52.866822 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-44d668e5-596c-4400-84c5-09efcb48e16d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.264993 Jul 18 08:46:52.867936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 38/70] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:52 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:52.948459 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9a282a71-ff92-46a2-9303-da00e9f749de tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:52.951499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9a282a71-ff92-46a2-9303-da00e9f749de tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:52.965401 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a282a71-ff92-46a2-9303-da00e9f749de tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:52.969529 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a282a71-ff92-46a2-9303-da00e9f749de tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:52.969529 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a282a71-ff92-46a2-9303-da00e9f749de tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:52.969529 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a282a71-ff92-46a2-9303-da00e9f749de tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:53.503879 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9a282a71-ff92-46a2-9303-da00e9f749de tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:53.523119 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9a282a71-ff92-46a2-9303-da00e9f749de tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.577236 Jul 18 08:46:53.523119 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 39/71] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:52 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:46:53.618530 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1f96c4cc-4e08-4f14-846f-909acb0f4db8 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:53.619392 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1f96c4cc-4e08-4f14-846f-909acb0f4db8 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:53.640660 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1f96c4cc-4e08-4f14-846f-909acb0f4db8 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:53.641116 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1f96c4cc-4e08-4f14-846f-909acb0f4db8 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:53.645901 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1f96c4cc-4e08-4f14-846f-909acb0f4db8 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:53.653180 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1f96c4cc-4e08-4f14-846f-909acb0f4db8 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:53.897353 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f2dc3af4-7f82-4b12-bfda-bafb0277b2a8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:53.908922 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f2dc3af4-7f82-4b12-bfda-bafb0277b2a8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 1.099828 Jul 18 08:46:53.909582 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 33/72] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:52 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:53.924296 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9ca1f128-4131-44ac-a4a5-becf102d5e81 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:53.925002 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9ca1f128-4131-44ac-a4a5-becf102d5e81 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:53.942610 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9ca1f128-4131-44ac-a4a5-becf102d5e81 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:53.943144 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9ca1f128-4131-44ac-a4a5-becf102d5e81 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:53.944197 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9ca1f128-4131-44ac-a4a5-becf102d5e81 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:53.944660 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9ca1f128-4131-44ac-a4a5-becf102d5e81 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:54.505924 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1f96c4cc-4e08-4f14-846f-909acb0f4db8 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:54.535630 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1f96c4cc-4e08-4f14-846f-909acb0f4db8 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 0.920377 Jul 18 08:46:54.538779 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 40/73] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:53 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:54.557781 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-925d9b65-3790-4262-b537-10ee8e12076d req-56fa6e17-5175-4162-a23a-41c13384fb23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcda6e64-2c95-4eb7-bff6-6e13f99e254e", "tag": "01362a2e-5dd9-4114-9738-0a7259b6d8be"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:54.587789 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=10 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:54.599176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-925d9b65-3790-4262-b537-10ee8e12076d req-56fa6e17-5175-4162-a23a-41c13384fb23 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:54.601556 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-925d9b65-3790-4262-b537-10ee8e12076d req-56fa6e17-5175-4162-a23a-41c13384fb23 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:54.667457 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-925d9b65-3790-4262-b537-10ee8e12076d req-56fa6e17-5175-4162-a23a-41c13384fb23 service nova] Creating event network-changed:01362a2e-5dd9-4114-9738-0a7259b6d8be for instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e on hv-cinder-85014 Jul 18 08:46:54.672167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-925d9b65-3790-4262-b537-10ee8e12076d req-56fa6e17-5175-4162-a23a-41c13384fb23 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124894) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 08:46:54.696060 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6993b693-4420-4506-a693-190e71aaa390 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:54.697178 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6993b693-4420-4506-a693-190e71aaa390 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:54.698536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6993b693-4420-4506-a693-190e71aaa390 None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:54.699494 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6993b693-4420-4506-a693-190e71aaa390 None None] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:54.720467 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.compute.rpcapi [None req-6993b693-4420-4506-a693-190e71aaa390 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 08:46:54.727605 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6993b693-4420-4506-a693-190e71aaa390 None None] Releasing lock "compute-rpcapi-router" {{(pid=124894) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 08:46:54.759259 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6993b693-4420-4506-a693-190e71aaa390 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218171 Jul 18 08:46:54.760131 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 41/74] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:46:54.777455 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-111af551-2afa-47d1-9437-e9ce33d0b837 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:54.780448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-111af551-2afa-47d1-9437-e9ce33d0b837 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:54.784373 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9ca1f128-4131-44ac-a4a5-becf102d5e81 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:54.808116 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-111af551-2afa-47d1-9437-e9ce33d0b837 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:54.808116 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-111af551-2afa-47d1-9437-e9ce33d0b837 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:54.809510 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-111af551-2afa-47d1-9437-e9ce33d0b837 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:54.811197 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-111af551-2afa-47d1-9437-e9ce33d0b837 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:54.813282 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9ca1f128-4131-44ac-a4a5-becf102d5e81 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1363 microversion: 2.1 time: 0.898904 Jul 18 08:46:54.813898 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 34/75] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:53 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1363 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:54.839421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-36beb1c3-71b7-4113-ad90-3ec2fa0bd339 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:54.839421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-36beb1c3-71b7-4113-ad90-3ec2fa0bd339 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:54.855504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-36beb1c3-71b7-4113-ad90-3ec2fa0bd339 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:54.858317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-36beb1c3-71b7-4113-ad90-3ec2fa0bd339 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:54.859288 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-36beb1c3-71b7-4113-ad90-3ec2fa0bd339 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:54.859782 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-36beb1c3-71b7-4113-ad90-3ec2fa0bd339 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:55.381368 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-111af551-2afa-47d1-9437-e9ce33d0b837 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:55.404124 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=100 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:46:55.423014 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-111af551-2afa-47d1-9437-e9ce33d0b837 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:55.442822 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-111af551-2afa-47d1-9437-e9ce33d0b837 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:55.445384 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-111af551-2afa-47d1-9437-e9ce33d0b837 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.683311 Jul 18 08:46:55.448480 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 42/76] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:54 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:55.472464 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b5d20a52-90b8-4e7b-a419-4f401ef65264 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:55.474048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b5d20a52-90b8-4e7b-a419-4f401ef65264 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:55.500744 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b5d20a52-90b8-4e7b-a419-4f401ef65264 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:55.502113 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b5d20a52-90b8-4e7b-a419-4f401ef65264 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:55.509910 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b5d20a52-90b8-4e7b-a419-4f401ef65264 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:55.514703 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b5d20a52-90b8-4e7b-a419-4f401ef65264 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:55.718519 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-36beb1c3-71b7-4113-ad90-3ec2fa0bd339 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:55.815654 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-36beb1c3-71b7-4113-ad90-3ec2fa0bd339 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.982066 Jul 18 08:46:55.822104 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 35/77] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:54 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:56.179243 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-83092b15-94bf-4aac-9c79-826cc07fd99f req-8e4300cf-f377-4b93-9b14-d7cdf62896f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efda553-6895-4088-a371-4c3d6fb05969", "name": "network-vif-plugged", "status": "completed", "tag": "b8385ec2-63dc-4baa-baa7-44b6b21c02d5"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:56.193541 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-83092b15-94bf-4aac-9c79-826cc07fd99f req-8e4300cf-f377-4b93-9b14-d7cdf62896f9 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:56.194488 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-83092b15-94bf-4aac-9c79-826cc07fd99f req-8e4300cf-f377-4b93-9b14-d7cdf62896f9 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:56.264296 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-83092b15-94bf-4aac-9c79-826cc07fd99f req-8e4300cf-f377-4b93-9b14-d7cdf62896f9 service nova] Creating event network-vif-plugged:b8385ec2-63dc-4baa-baa7-44b6b21c02d5 for instance 9efda553-6895-4088-a371-4c3d6fb05969 on hv-cinder-85014 Jul 18 08:46:56.275634 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-83092b15-94bf-4aac-9c79-826cc07fd99f req-8e4300cf-f377-4b93-9b14-d7cdf62896f9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.425561 Jul 18 08:46:56.277957 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 36/78] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:46:56.298747 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-42e34cc0-be3d-489d-b3b8-3f1baee7d595 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:56.304135 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-42e34cc0-be3d-489d-b3b8-3f1baee7d595 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:56.317910 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-42e34cc0-be3d-489d-b3b8-3f1baee7d595 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:56.318626 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-42e34cc0-be3d-489d-b3b8-3f1baee7d595 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:56.319728 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-42e34cc0-be3d-489d-b3b8-3f1baee7d595 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:56.320374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-42e34cc0-be3d-489d-b3b8-3f1baee7d595 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:56.574906 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b5d20a52-90b8-4e7b-a419-4f401ef65264 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:56.605669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b5d20a52-90b8-4e7b-a419-4f401ef65264 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 1.154899 Jul 18 08:46:56.628558 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 43/79] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:55 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:57.083316 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-76dda317-95ed-4c8f-ae88-8aaadbdf1c7e req-3f92ecac-9576-4d75-a7b1-084896e52be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d6245b-0c6d-4a19-85c6-841d85912f2e", "tag": "222385f0-b84b-466b-a9f5-dab4e9dadd74"}, {"name": "network-changed", "server_uuid": "84de371b-4af7-43af-be6d-ed94e96dcd91", "tag": "88a52aef-93c6-4a56-800d-706ae67440c0"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:57.173621 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-76dda317-95ed-4c8f-ae88-8aaadbdf1c7e req-3f92ecac-9576-4d75-a7b1-084896e52be2 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:57.177735 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-76dda317-95ed-4c8f-ae88-8aaadbdf1c7e req-3f92ecac-9576-4d75-a7b1-084896e52be2 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:57.221670 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-76dda317-95ed-4c8f-ae88-8aaadbdf1c7e req-3f92ecac-9576-4d75-a7b1-084896e52be2 service nova] Creating event network-changed:222385f0-b84b-466b-a9f5-dab4e9dadd74 for instance f3d6245b-0c6d-4a19-85c6-841d85912f2e on hv-cinder-85014 Jul 18 08:46:57.223159 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-76dda317-95ed-4c8f-ae88-8aaadbdf1c7e req-3f92ecac-9576-4d75-a7b1-084896e52be2 service nova] Creating event network-changed:88a52aef-93c6-4a56-800d-706ae67440c0 for instance 84de371b-4af7-43af-be6d-ed94e96dcd91 on hv-cinder-85014 Jul 18 08:46:57.233797 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-42e34cc0-be3d-489d-b3b8-3f1baee7d595 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:57.243320 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-76dda317-95ed-4c8f-ae88-8aaadbdf1c7e req-3f92ecac-9576-4d75-a7b1-084896e52be2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.597905 Jul 18 08:46:57.245589 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 44/80] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:46:57.257483 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-53f699c3-21f2-4f97-9041-538cfba7c916 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:57.260395 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-53f699c3-21f2-4f97-9041-538cfba7c916 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:57.265371 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-42e34cc0-be3d-489d-b3b8-3f1baee7d595 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 0.983589 Jul 18 08:46:57.269634 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 37/81] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:56 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:57.289153 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-53f699c3-21f2-4f97-9041-538cfba7c916 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:57.292904 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-53f699c3-21f2-4f97-9041-538cfba7c916 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:57.296485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-58adcd29-af08-4c4e-8840-77294781fad4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:57.298075 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-58adcd29-af08-4c4e-8840-77294781fad4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:57.299092 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-53f699c3-21f2-4f97-9041-538cfba7c916 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:57.300454 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-53f699c3-21f2-4f97-9041-538cfba7c916 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:57.314828 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-58adcd29-af08-4c4e-8840-77294781fad4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:57.315619 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-58adcd29-af08-4c4e-8840-77294781fad4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:57.316483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-58adcd29-af08-4c4e-8840-77294781fad4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:57.316929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-58adcd29-af08-4c4e-8840-77294781fad4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:57.962265 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-53f699c3-21f2-4f97-9041-538cfba7c916 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:57.973102 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-53f699c3-21f2-4f97-9041-538cfba7c916 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1363 microversion: 2.1 time: 0.724457 Jul 18 08:46:57.974273 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 45/82] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:57 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1363 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:58.008653 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-77b6abc4-1cb5-4984-a422-46f106864329 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:58.009799 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-77b6abc4-1cb5-4984-a422-46f106864329 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:58.036931 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-77b6abc4-1cb5-4984-a422-46f106864329 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:58.042034 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-77b6abc4-1cb5-4984-a422-46f106864329 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:58.043823 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-77b6abc4-1cb5-4984-a422-46f106864329 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:58.046313 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-77b6abc4-1cb5-4984-a422-46f106864329 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:58.197087 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-58adcd29-af08-4c4e-8840-77294781fad4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:58.207593 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-58adcd29-af08-4c4e-8840-77294781fad4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:58.209554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-58adcd29-af08-4c4e-8840-77294781fad4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:58.210942 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-58adcd29-af08-4c4e-8840-77294781fad4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.935319 Jul 18 08:46:58.222136 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 38/83] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:57 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:46:58.227433 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1fe59ec1-f022-4794-ae61-488dc4da9a5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:58.228446 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1fe59ec1-f022-4794-ae61-488dc4da9a5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:58.236636 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1fe59ec1-f022-4794-ae61-488dc4da9a5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:58.237889 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1fe59ec1-f022-4794-ae61-488dc4da9a5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:58.240384 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1fe59ec1-f022-4794-ae61-488dc4da9a5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:58.240384 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1fe59ec1-f022-4794-ae61-488dc4da9a5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:58.412740 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-77b6abc4-1cb5-4984-a422-46f106864329 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:58.427957 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-77b6abc4-1cb5-4984-a422-46f106864329 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.451633 Jul 18 08:46:58.429483 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 46/84] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:57 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:58.453079 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d05a45dd-6c4a-4754-9993-b7b7f4067af9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:58.455035 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d05a45dd-6c4a-4754-9993-b7b7f4067af9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:58.484333 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d05a45dd-6c4a-4754-9993-b7b7f4067af9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:58.498341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d05a45dd-6c4a-4754-9993-b7b7f4067af9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:58.498341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d05a45dd-6c4a-4754-9993-b7b7f4067af9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:58.498341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d05a45dd-6c4a-4754-9993-b7b7f4067af9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:58.855944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d05a45dd-6c4a-4754-9993-b7b7f4067af9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:58.872950 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d05a45dd-6c4a-4754-9993-b7b7f4067af9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 0.440576 Jul 18 08:46:58.874511 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 47/85] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:58 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:58.884226 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-de291bfe-219c-4664-927f-a8c510595d74 req-ab68073e-7328-4c2c-b84c-6c64903561f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75cd9ec0-94a9-4043-983e-d876084556ad", "name": "network-vif-plugged", "status": "completed", "tag": "78901683-090c-493b-919a-d66d30e8239b"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:58.901085 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-de291bfe-219c-4664-927f-a8c510595d74 req-ab68073e-7328-4c2c-b84c-6c64903561f4 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:58.902069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-de291bfe-219c-4664-927f-a8c510595d74 req-ab68073e-7328-4c2c-b84c-6c64903561f4 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:58.925364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-de291bfe-219c-4664-927f-a8c510595d74 req-ab68073e-7328-4c2c-b84c-6c64903561f4 service nova] Creating event network-vif-plugged:78901683-090c-493b-919a-d66d30e8239b for instance 75cd9ec0-94a9-4043-983e-d876084556ad on hv-cinder-85014 Jul 18 08:46:58.935368 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-de291bfe-219c-4664-927f-a8c510595d74 req-ab68073e-7328-4c2c-b84c-6c64903561f4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058314 Jul 18 08:46:58.936726 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 48/86] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:46:59.014913 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-dd100a8a-874e-4ac9-93ff-fb974153b350 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:59.020897 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-dd100a8a-874e-4ac9-93ff-fb974153b350 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:59.040235 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dd100a8a-874e-4ac9-93ff-fb974153b350 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:59.041006 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dd100a8a-874e-4ac9-93ff-fb974153b350 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:59.042323 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dd100a8a-874e-4ac9-93ff-fb974153b350 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:59.046470 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dd100a8a-874e-4ac9-93ff-fb974153b350 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:59.177978 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1fe59ec1-f022-4794-ae61-488dc4da9a5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:59.192267 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1fe59ec1-f022-4794-ae61-488dc4da9a5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.968619 Jul 18 08:46:59.196779 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 39/87] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:58 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:59.235639 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-65115012-f93e-419e-b773-23a8ab2397c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:59.235639 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-65115012-f93e-419e-b773-23a8ab2397c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:59.239079 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-65115012-f93e-419e-b773-23a8ab2397c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:59.240110 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-65115012-f93e-419e-b773-23a8ab2397c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:59.240509 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-65115012-f93e-419e-b773-23a8ab2397c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:59.241268 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-65115012-f93e-419e-b773-23a8ab2397c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:59.308088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-dd100a8a-874e-4ac9-93ff-fb974153b350 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:59.322658 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-dd100a8a-874e-4ac9-93ff-fb974153b350 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1363 microversion: 2.1 time: 0.319112 Jul 18 08:46:59.324401 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 49/88] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:59 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:46:59.333992 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-a7424f38-8a2c-4aa5-9e75-9a2413611834 req-82109d10-e026-4c1c-8687-4edc6d9f76c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866bad59-8906-4710-9fbb-63e95c376010", "tag": "47a3e70e-f8bb-43b0-84c0-a2b560f6cacd"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:46:59.349682 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-a7424f38-8a2c-4aa5-9e75-9a2413611834 req-82109d10-e026-4c1c-8687-4edc6d9f76c0 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:59.351513 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-a7424f38-8a2c-4aa5-9e75-9a2413611834 req-82109d10-e026-4c1c-8687-4edc6d9f76c0 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:59.370521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-a7424f38-8a2c-4aa5-9e75-9a2413611834 req-82109d10-e026-4c1c-8687-4edc6d9f76c0 service nova] Creating event network-changed:47a3e70e-f8bb-43b0-84c0-a2b560f6cacd for instance 866bad59-8906-4710-9fbb-63e95c376010 on hv-cinder-85014 Jul 18 08:46:59.380706 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-a7424f38-8a2c-4aa5-9e75-9a2413611834 req-82109d10-e026-4c1c-8687-4edc6d9f76c0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053141 Jul 18 08:46:59.382274 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 50/89] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:46:59.445884 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-65115012-f93e-419e-b773-23a8ab2397c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:59.456393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9efd2b3f-7c91-4a93-af97-6f00dd6ca044 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:59.458535 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9efd2b3f-7c91-4a93-af97-6f00dd6ca044 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:59.466814 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-65115012-f93e-419e-b773-23a8ab2397c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:59.471230 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-65115012-f93e-419e-b773-23a8ab2397c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:59.473041 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9efd2b3f-7c91-4a93-af97-6f00dd6ca044 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:59.473810 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9efd2b3f-7c91-4a93-af97-6f00dd6ca044 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:59.473952 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-65115012-f93e-419e-b773-23a8ab2397c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.248092 Jul 18 08:46:59.475265 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9efd2b3f-7c91-4a93-af97-6f00dd6ca044 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:59.475422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 40/90] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:46:59 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:46:59.476726 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9efd2b3f-7c91-4a93-af97-6f00dd6ca044 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:59.717151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9efd2b3f-7c91-4a93-af97-6f00dd6ca044 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:46:59.732548 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9efd2b3f-7c91-4a93-af97-6f00dd6ca044 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.284982 Jul 18 08:46:59.742722 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 51/91] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:59 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:46:59.893271 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-93905ca3-ff06-436e-ba24-a1bed00c73a3 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:46:59.894234 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-93905ca3-ff06-436e-ba24-a1bed00c73a3 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:46:59.901615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-93905ca3-ff06-436e-ba24-a1bed00c73a3 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:59.902312 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-93905ca3-ff06-436e-ba24-a1bed00c73a3 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:46:59.904089 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-93905ca3-ff06-436e-ba24-a1bed00c73a3 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:46:59.904437 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-93905ca3-ff06-436e-ba24-a1bed00c73a3 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:00.149850 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-93905ca3-ff06-436e-ba24-a1bed00c73a3 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:00.159043 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-93905ca3-ff06-436e-ba24-a1bed00c73a3 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1315 microversion: 2.1 time: 0.270697 Jul 18 08:47:00.159649 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 41/92] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:46:59 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:00.224351 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-669ddf4a-7cdb-4d1f-82e7-82530c980646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:00.225676 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-669ddf4a-7cdb-4d1f-82e7-82530c980646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:00.251146 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-669ddf4a-7cdb-4d1f-82e7-82530c980646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:00.252067 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-669ddf4a-7cdb-4d1f-82e7-82530c980646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:00.254675 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-669ddf4a-7cdb-4d1f-82e7-82530c980646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:00.256290 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-669ddf4a-7cdb-4d1f-82e7-82530c980646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:00.349090 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ed7d12fb-ab79-4cd9-baa0-57285a2c89fa tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:00.349758 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ed7d12fb-ab79-4cd9-baa0-57285a2c89fa tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:00.364081 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ed7d12fb-ab79-4cd9-baa0-57285a2c89fa tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:00.365120 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ed7d12fb-ab79-4cd9-baa0-57285a2c89fa tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:00.366914 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ed7d12fb-ab79-4cd9-baa0-57285a2c89fa tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:00.368327 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ed7d12fb-ab79-4cd9-baa0-57285a2c89fa tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:00.545479 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-669ddf4a-7cdb-4d1f-82e7-82530c980646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:00.568079 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-669ddf4a-7cdb-4d1f-82e7-82530c980646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.352065 Jul 18 08:47:00.571487 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 52/93] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:00 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:00.594519 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2e1c8fba-914d-44d6-bfe4-49fae9b45eba tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:00.595910 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-2e1c8fba-914d-44d6-bfe4-49fae9b45eba tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:00.608773 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2e1c8fba-914d-44d6-bfe4-49fae9b45eba tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:00.609982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2e1c8fba-914d-44d6-bfe4-49fae9b45eba tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:00.611990 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2e1c8fba-914d-44d6-bfe4-49fae9b45eba tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:00.612853 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2e1c8fba-914d-44d6-bfe4-49fae9b45eba tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:00.656993 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ed7d12fb-ab79-4cd9-baa0-57285a2c89fa tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:00.665385 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ed7d12fb-ab79-4cd9-baa0-57285a2c89fa tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1363 microversion: 2.1 time: 0.325962 Jul 18 08:47:00.665991 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 42/94] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:00 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:00.765368 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-75414e6d-75dc-4e08-8718-d696b780a263 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:00.767326 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-75414e6d-75dc-4e08-8718-d696b780a263 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:00.791914 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-75414e6d-75dc-4e08-8718-d696b780a263 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:00.792890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-75414e6d-75dc-4e08-8718-d696b780a263 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:00.794956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-75414e6d-75dc-4e08-8718-d696b780a263 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:00.798016 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-75414e6d-75dc-4e08-8718-d696b780a263 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:00.861312 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=100 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:00.975733 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2e1c8fba-914d-44d6-bfe4-49fae9b45eba tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:01.001394 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2e1c8fba-914d-44d6-bfe4-49fae9b45eba tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:01.004517 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2e1c8fba-914d-44d6-bfe4-49fae9b45eba tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:01.006522 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2e1c8fba-914d-44d6-bfe4-49fae9b45eba tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.432713 Jul 18 08:47:01.011238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 53/95] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:00 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:47:01.039132 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-adfef51c-3238-47d7-ad78-2b3aa6658159 req-5493651e-4a50-47e6-9e95-7552b7ee3120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcda6e64-2c95-4eb7-bff6-6e13f99e254e", "name": "network-vif-plugged", "status": "completed", "tag": "01362a2e-5dd9-4114-9738-0a7259b6d8be"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:47:01.059814 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-adfef51c-3238-47d7-ad78-2b3aa6658159 req-5493651e-4a50-47e6-9e95-7552b7ee3120 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:01.060566 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-adfef51c-3238-47d7-ad78-2b3aa6658159 req-5493651e-4a50-47e6-9e95-7552b7ee3120 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:01.095289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-adfef51c-3238-47d7-ad78-2b3aa6658159 req-5493651e-4a50-47e6-9e95-7552b7ee3120 service nova] Creating event network-vif-plugged:01362a2e-5dd9-4114-9738-0a7259b6d8be for instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e on hv-cinder-85014 Jul 18 08:47:01.102859 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-adfef51c-3238-47d7-ad78-2b3aa6658159 req-5493651e-4a50-47e6-9e95-7552b7ee3120 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084970 Jul 18 08:47:01.103824 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 54/96] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:01.165315 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-75414e6d-75dc-4e08-8718-d696b780a263 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:01.179709 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7b2a0731-52fc-4195-9b18-b92ad13bfddb tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:01.180167 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-75414e6d-75dc-4e08-8718-d696b780a263 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.422508 Jul 18 08:47:01.180729 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7b2a0731-52fc-4195-9b18-b92ad13bfddb tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:01.181397 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 43/97] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:00 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:01.189661 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b2a0731-52fc-4195-9b18-b92ad13bfddb tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:01.190539 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b2a0731-52fc-4195-9b18-b92ad13bfddb tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:01.191772 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b2a0731-52fc-4195-9b18-b92ad13bfddb tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:01.192772 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b2a0731-52fc-4195-9b18-b92ad13bfddb tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:01.408324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7b2a0731-52fc-4195-9b18-b92ad13bfddb tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:01.417094 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7b2a0731-52fc-4195-9b18-b92ad13bfddb tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1503 microversion: 2.1 time: 0.243545 Jul 18 08:47:01.417606 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 55/98] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:01 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1503 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:01.595465 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-48e94bb8-520e-4762-9098-90351db41dc4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:01.596472 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-48e94bb8-520e-4762-9098-90351db41dc4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:01.603312 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-48e94bb8-520e-4762-9098-90351db41dc4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:01.603803 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-48e94bb8-520e-4762-9098-90351db41dc4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:01.604650 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-48e94bb8-520e-4762-9098-90351db41dc4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:01.605093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-48e94bb8-520e-4762-9098-90351db41dc4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:01.692968 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-911e71a7-d54f-4b94-8a82-8efab163c72e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:01.694144 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-911e71a7-d54f-4b94-8a82-8efab163c72e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:01.706916 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-911e71a7-d54f-4b94-8a82-8efab163c72e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:01.707814 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-911e71a7-d54f-4b94-8a82-8efab163c72e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:01.709258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-911e71a7-d54f-4b94-8a82-8efab163c72e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:01.710097 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-911e71a7-d54f-4b94-8a82-8efab163c72e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:01.836187 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-48e94bb8-520e-4762-9098-90351db41dc4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:01.860043 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-48e94bb8-520e-4762-9098-90351db41dc4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.269515 Jul 18 08:47:01.861684 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 44/99] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:01 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:01.947114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-911e71a7-d54f-4b94-8a82-8efab163c72e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:01.956915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-911e71a7-d54f-4b94-8a82-8efab163c72e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1363 microversion: 2.1 time: 0.272972 Jul 18 08:47:01.957587 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 56/100] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:01 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:02.046835 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4bceb939-1866-4aa0-8d41-2aadc02183b7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:02.052684 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-4bceb939-1866-4aa0-8d41-2aadc02183b7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:02.072891 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4bceb939-1866-4aa0-8d41-2aadc02183b7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:02.074401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4bceb939-1866-4aa0-8d41-2aadc02183b7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:02.077015 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4bceb939-1866-4aa0-8d41-2aadc02183b7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:02.079655 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4bceb939-1866-4aa0-8d41-2aadc02183b7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:02.216671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f03f52da-ed91-40ec-bacd-8979b029429e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:02.218182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f03f52da-ed91-40ec-bacd-8979b029429e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:02.229876 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f03f52da-ed91-40ec-bacd-8979b029429e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:02.231100 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f03f52da-ed91-40ec-bacd-8979b029429e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:02.233440 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f03f52da-ed91-40ec-bacd-8979b029429e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:02.234482 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f03f52da-ed91-40ec-bacd-8979b029429e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:02.704155 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f03f52da-ed91-40ec-bacd-8979b029429e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:02.733228 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f03f52da-ed91-40ec-bacd-8979b029429e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.527227 Jul 18 08:47:02.737441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 57/101] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:02 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:02.810139 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4bceb939-1866-4aa0-8d41-2aadc02183b7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:02.819762 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4bceb939-1866-4aa0-8d41-2aadc02183b7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:02.822526 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4bceb939-1866-4aa0-8d41-2aadc02183b7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:02.824010 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-4bceb939-1866-4aa0-8d41-2aadc02183b7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.789696 Jul 18 08:47:02.849548 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 45/102] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:02 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:47:02.879266 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-acdbc213-26f2-42e0-af9d-ad5c27601e3f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:02.879937 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-acdbc213-26f2-42e0-af9d-ad5c27601e3f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:02.892751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-acdbc213-26f2-42e0-af9d-ad5c27601e3f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:02.893726 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-acdbc213-26f2-42e0-af9d-ad5c27601e3f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:02.895302 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-acdbc213-26f2-42e0-af9d-ad5c27601e3f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:02.897458 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-acdbc213-26f2-42e0-af9d-ad5c27601e3f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:02.986061 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a074f3c3-011e-481e-8312-c3223c2cf41c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:02.986747 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a074f3c3-011e-481e-8312-c3223c2cf41c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:02.994356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a074f3c3-011e-481e-8312-c3223c2cf41c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:03.001710 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a074f3c3-011e-481e-8312-c3223c2cf41c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:03.001710 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a074f3c3-011e-481e-8312-c3223c2cf41c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:03.001710 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a074f3c3-011e-481e-8312-c3223c2cf41c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:03.158797 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-acdbc213-26f2-42e0-af9d-ad5c27601e3f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:03.170325 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-acdbc213-26f2-42e0-af9d-ad5c27601e3f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.294299 Jul 18 08:47:03.185222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 58/103] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:02 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:03.268797 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a074f3c3-011e-481e-8312-c3223c2cf41c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:03.279238 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a074f3c3-011e-481e-8312-c3223c2cf41c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1363 microversion: 2.1 time: 0.297766 Jul 18 08:47:03.280250 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 46/104] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:02 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:03.781296 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9a83aa22-9fc9-4f7d-8939-9a8009b9be37 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:03.783485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9a83aa22-9fc9-4f7d-8939-9a8009b9be37 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:03.795917 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a83aa22-9fc9-4f7d-8939-9a8009b9be37 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:03.797281 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a83aa22-9fc9-4f7d-8939-9a8009b9be37 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:03.799238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a83aa22-9fc9-4f7d-8939-9a8009b9be37 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:03.800544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9a83aa22-9fc9-4f7d-8939-9a8009b9be37 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:03.850566 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-450cf7ca-f040-42da-a692-70b8df085caf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:03.851957 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-450cf7ca-f040-42da-a692-70b8df085caf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:03.876704 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-450cf7ca-f040-42da-a692-70b8df085caf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:03.877593 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-450cf7ca-f040-42da-a692-70b8df085caf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:03.879057 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-450cf7ca-f040-42da-a692-70b8df085caf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:03.879886 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-450cf7ca-f040-42da-a692-70b8df085caf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:04.235845 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9a83aa22-9fc9-4f7d-8939-9a8009b9be37 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:04.283724 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9a83aa22-9fc9-4f7d-8939-9a8009b9be37 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.500794 Jul 18 08:47:04.289480 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 59/105] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:03 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:04.306255 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d1145f0a-b0fc-46f7-b88c-91c136b153d9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efcc5188-5b3c-4875-b5a2-61e0b74c0bdc"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:47:04.310224 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d1145f0a-b0fc-46f7-b88c-91c136b153d9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:04.323573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1145f0a-b0fc-46f7-b88c-91c136b153d9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:04.324877 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1145f0a-b0fc-46f7-b88c-91c136b153d9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:04.327032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1145f0a-b0fc-46f7-b88c-91c136b153d9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:04.328777 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1145f0a-b0fc-46f7-b88c-91c136b153d9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:04.590259 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-450cf7ca-f040-42da-a692-70b8df085caf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:04.601511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-450cf7ca-f040-42da-a692-70b8df085caf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:04.604450 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-450cf7ca-f040-42da-a692-70b8df085caf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:04.606127 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-450cf7ca-f040-42da-a692-70b8df085caf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.764675 Jul 18 08:47:04.619154 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 47/106] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:03 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:47:04.625724 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-cdd19bab-37f6-48d0-966f-df40838bdb93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:04.626924 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-cdd19bab-37f6-48d0-966f-df40838bdb93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:04.634149 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cdd19bab-37f6-48d0-966f-df40838bdb93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:04.635076 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cdd19bab-37f6-48d0-966f-df40838bdb93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:04.636364 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cdd19bab-37f6-48d0-966f-df40838bdb93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:04.637103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cdd19bab-37f6-48d0-966f-df40838bdb93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:04.718013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:04.979530 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-cdd19bab-37f6-48d0-966f-df40838bdb93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:04.991346 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-cdd19bab-37f6-48d0-966f-df40838bdb93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.370558 Jul 18 08:47:04.991981 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 48/107] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:04 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:04.997136 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-012f497a-c1ec-4258-89bc-b9d72804d52d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:04.998250 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-012f497a-c1ec-4258-89bc-b9d72804d52d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:05.005134 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-012f497a-c1ec-4258-89bc-b9d72804d52d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:05.005574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-012f497a-c1ec-4258-89bc-b9d72804d52d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:05.006583 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-012f497a-c1ec-4258-89bc-b9d72804d52d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:05.007230 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-012f497a-c1ec-4258-89bc-b9d72804d52d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:05.201203 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-012f497a-c1ec-4258-89bc-b9d72804d52d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:05.216850 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-012f497a-c1ec-4258-89bc-b9d72804d52d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1363 microversion: 2.1 time: 0.222603 Jul 18 08:47:05.216850 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 49/108] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:04 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:05.308579 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e8935561-47f4-48f0-b326-7afbf45b2887 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:05.310738 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e8935561-47f4-48f0-b326-7afbf45b2887 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:05.318779 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e8935561-47f4-48f0-b326-7afbf45b2887 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:05.319221 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e8935561-47f4-48f0-b326-7afbf45b2887 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:05.320585 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e8935561-47f4-48f0-b326-7afbf45b2887 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:05.321142 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e8935561-47f4-48f0-b326-7afbf45b2887 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:05.830145 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e8935561-47f4-48f0-b326-7afbf45b2887 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:05.857701 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e8935561-47f4-48f0-b326-7afbf45b2887 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.555405 Jul 18 08:47:05.880267 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 50/109] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:05 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:05.913013 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ee661186-cbd7-4ff5-bbd2-e832f7c45042 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:05.914281 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ee661186-cbd7-4ff5-bbd2-e832f7c45042 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:05.930032 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ee661186-cbd7-4ff5-bbd2-e832f7c45042 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:05.931016 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ee661186-cbd7-4ff5-bbd2-e832f7c45042 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:05.932510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ee661186-cbd7-4ff5-bbd2-e832f7c45042 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:05.934598 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ee661186-cbd7-4ff5-bbd2-e832f7c45042 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:06.158553 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:06.306832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d1145f0a-b0fc-46f7-b88c-91c136b153d9 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "POST /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.014559 Jul 18 08:47:06.308334 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 60/110] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:47:04 2022] POST /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969/os-volume_attachments => generated 194 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:06.320129 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b54c4874-30c9-4bbb-b86c-23fb13d59ebf tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:06.321957 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b54c4874-30c9-4bbb-b86c-23fb13d59ebf tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:06.338393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b54c4874-30c9-4bbb-b86c-23fb13d59ebf tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:06.339557 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b54c4874-30c9-4bbb-b86c-23fb13d59ebf tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:06.343370 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b54c4874-30c9-4bbb-b86c-23fb13d59ebf tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:06.344258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b54c4874-30c9-4bbb-b86c-23fb13d59ebf tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:06.346563 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ee661186-cbd7-4ff5-bbd2-e832f7c45042 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:06.362197 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ee661186-cbd7-4ff5-bbd2-e832f7c45042 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:06.365203 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ee661186-cbd7-4ff5-bbd2-e832f7c45042 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:06.367479 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ee661186-cbd7-4ff5-bbd2-e832f7c45042 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.485034 Jul 18 08:47:06.368436 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 51/111] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:05 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:47:06.377697 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-97ba8aa7-c394-497f-acd7-cd23450ac9eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:06.378648 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-97ba8aa7-c394-497f-acd7-cd23450ac9eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:06.391476 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-97ba8aa7-c394-497f-acd7-cd23450ac9eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:06.392296 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-97ba8aa7-c394-497f-acd7-cd23450ac9eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:06.393817 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-97ba8aa7-c394-497f-acd7-cd23450ac9eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:06.394669 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-97ba8aa7-c394-497f-acd7-cd23450ac9eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:06.599959 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b54c4874-30c9-4bbb-b86c-23fb13d59ebf tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:06.611049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b54c4874-30c9-4bbb-b86c-23fb13d59ebf tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.298225 Jul 18 08:47:06.616214 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 61/112] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:06 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:06.616431 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-97ba8aa7-c394-497f-acd7-cd23450ac9eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:06.624120 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-97ba8aa7-c394-497f-acd7-cd23450ac9eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1549 microversion: 2.1 time: 0.253540 Jul 18 08:47:06.624712 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 52/113] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:06 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1549 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:06.654047 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2e64fb15-3cf2-4d87-98da-ed33c128cfd3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:06.654729 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-2e64fb15-3cf2-4d87-98da-ed33c128cfd3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:06.662520 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2e64fb15-3cf2-4d87-98da-ed33c128cfd3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:06.662978 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2e64fb15-3cf2-4d87-98da-ed33c128cfd3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:06.663801 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2e64fb15-3cf2-4d87-98da-ed33c128cfd3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:06.664256 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2e64fb15-3cf2-4d87-98da-ed33c128cfd3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:06.772379 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2e64fb15-3cf2-4d87-98da-ed33c128cfd3 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123027 Jul 18 08:47:06.773364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 62/114] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 08:47:06 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:06.888614 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-79514478-858b-4c7a-bdbc-bddd74491c7c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:06.889558 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-79514478-858b-4c7a-bdbc-bddd74491c7c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:06.899745 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-79514478-858b-4c7a-bdbc-bddd74491c7c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:06.900523 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-79514478-858b-4c7a-bdbc-bddd74491c7c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:06.902119 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-79514478-858b-4c7a-bdbc-bddd74491c7c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:06.902859 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-79514478-858b-4c7a-bdbc-bddd74491c7c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:07.129352 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-79514478-858b-4c7a-bdbc-bddd74491c7c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:07.146692 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-79514478-858b-4c7a-bdbc-bddd74491c7c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.262779 Jul 18 08:47:07.160661 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 53/115] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:06 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:07.404862 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-663e1125-1b55-4af4-a208-a528f4cfd211 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:07.406484 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-663e1125-1b55-4af4-a208-a528f4cfd211 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:07.420036 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-663e1125-1b55-4af4-a208-a528f4cfd211 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:07.420592 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-663e1125-1b55-4af4-a208-a528f4cfd211 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:07.422032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-663e1125-1b55-4af4-a208-a528f4cfd211 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:07.423050 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-663e1125-1b55-4af4-a208-a528f4cfd211 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:07.639885 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-12e6d4a9-90a1-49e4-a738-453866a330f7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:07.640631 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-12e6d4a9-90a1-49e4-a738-453866a330f7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:07.650242 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-12e6d4a9-90a1-49e4-a738-453866a330f7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:07.650705 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-12e6d4a9-90a1-49e4-a738-453866a330f7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:07.653151 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-12e6d4a9-90a1-49e4-a738-453866a330f7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:07.653151 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-12e6d4a9-90a1-49e4-a738-453866a330f7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:07.876867 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-12e6d4a9-90a1-49e4-a738-453866a330f7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:07.891588 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-12e6d4a9-90a1-49e4-a738-453866a330f7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.258181 Jul 18 08:47:07.892613 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 54/116] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:07 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:08.181169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-fd1a0485-84a3-47bf-8183-d54acd6ee8e2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:08.181169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-fd1a0485-84a3-47bf-8183-d54acd6ee8e2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:08.189760 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd1a0485-84a3-47bf-8183-d54acd6ee8e2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:08.190586 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd1a0485-84a3-47bf-8183-d54acd6ee8e2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:08.191622 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd1a0485-84a3-47bf-8183-d54acd6ee8e2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:08.192268 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd1a0485-84a3-47bf-8183-d54acd6ee8e2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:08.205931 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-663e1125-1b55-4af4-a208-a528f4cfd211 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:08.228829 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-663e1125-1b55-4af4-a208-a528f4cfd211 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:08.232743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-663e1125-1b55-4af4-a208-a528f4cfd211 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:08.234990 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-663e1125-1b55-4af4-a208-a528f4cfd211 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.835124 Jul 18 08:47:08.238531 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 63/117] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:07 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:47:08.660333 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-fd1a0485-84a3-47bf-8183-d54acd6ee8e2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:08.677297 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-fd1a0485-84a3-47bf-8183-d54acd6ee8e2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.503368 Jul 18 08:47:08.692193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 55/118] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:08 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:08.912698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-aafc33cf-5c63-4bbf-bec3-703483b3b630 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:08.914977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-aafc33cf-5c63-4bbf-bec3-703483b3b630 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:08.923278 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aafc33cf-5c63-4bbf-bec3-703483b3b630 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:08.925447 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aafc33cf-5c63-4bbf-bec3-703483b3b630 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:08.925447 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aafc33cf-5c63-4bbf-bec3-703483b3b630 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:08.925447 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aafc33cf-5c63-4bbf-bec3-703483b3b630 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:09.266292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f78338d1-8c98-44ea-99db-f3f07d9ed582 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:09.266850 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f78338d1-8c98-44ea-99db-f3f07d9ed582 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:09.282932 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-aafc33cf-5c63-4bbf-bec3-703483b3b630 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:09.303006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=85 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:09.312975 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-aafc33cf-5c63-4bbf-bec3-703483b3b630 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.406200 Jul 18 08:47:09.322691 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 64/119] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:08 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:09.323580 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f78338d1-8c98-44ea-99db-f3f07d9ed582 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:09.326134 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f78338d1-8c98-44ea-99db-f3f07d9ed582 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:09.328308 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f78338d1-8c98-44ea-99db-f3f07d9ed582 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:09.332694 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f78338d1-8c98-44ea-99db-f3f07d9ed582 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:09.383652 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-9610e436-28c2-45ef-a90b-ccd820e71850 req-dddaa58b-4036-4f07-9cf9-7a6099e45361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcda6e64-2c95-4eb7-bff6-6e13f99e254e", "tag": "01362a2e-5dd9-4114-9738-0a7259b6d8be"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:47:09.392954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=95 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:09.397768 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-9610e436-28c2-45ef-a90b-ccd820e71850 req-dddaa58b-4036-4f07-9cf9-7a6099e45361 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:09.398223 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-9610e436-28c2-45ef-a90b-ccd820e71850 req-dddaa58b-4036-4f07-9cf9-7a6099e45361 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:09.415043 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-9610e436-28c2-45ef-a90b-ccd820e71850 req-dddaa58b-4036-4f07-9cf9-7a6099e45361 service nova] Creating event network-changed:01362a2e-5dd9-4114-9738-0a7259b6d8be for instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e on hv-cinder-85014 Jul 18 08:47:09.427313 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-9610e436-28c2-45ef-a90b-ccd820e71850 req-dddaa58b-4036-4f07-9cf9-7a6099e45361 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049870 Jul 18 08:47:09.428831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 65/120] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:47:09.576107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f78338d1-8c98-44ea-99db-f3f07d9ed582 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:09.587304 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f78338d1-8c98-44ea-99db-f3f07d9ed582 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:09.594092 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f78338d1-8c98-44ea-99db-f3f07d9ed582 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:09.594092 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f78338d1-8c98-44ea-99db-f3f07d9ed582 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.329380 Jul 18 08:47:09.599987 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 56/121] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:09 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:47:09.712567 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8a4a5485-607a-4c56-a628-cb8e80d8df54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:09.714461 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8a4a5485-607a-4c56-a628-cb8e80d8df54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:09.730645 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8a4a5485-607a-4c56-a628-cb8e80d8df54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:09.732302 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8a4a5485-607a-4c56-a628-cb8e80d8df54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:09.733554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8a4a5485-607a-4c56-a628-cb8e80d8df54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:09.734333 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8a4a5485-607a-4c56-a628-cb8e80d8df54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:10.017996 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8a4a5485-607a-4c56-a628-cb8e80d8df54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:10.034626 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8a4a5485-607a-4c56-a628-cb8e80d8df54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.331636 Jul 18 08:47:10.049167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 66/122] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:09 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:10.337173 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-aae3c35d-a747-4f20-9421-e357655100f5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:10.338295 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-aae3c35d-a747-4f20-9421-e357655100f5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:10.348191 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aae3c35d-a747-4f20-9421-e357655100f5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:10.348922 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aae3c35d-a747-4f20-9421-e357655100f5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:10.350960 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aae3c35d-a747-4f20-9421-e357655100f5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:10.352102 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aae3c35d-a747-4f20-9421-e357655100f5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:10.619792 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-35cd9df1-b279-4aff-9369-c00400b2fa15 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:10.620899 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-35cd9df1-b279-4aff-9369-c00400b2fa15 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:10.651788 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-aae3c35d-a747-4f20-9421-e357655100f5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:10.652203 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-35cd9df1-b279-4aff-9369-c00400b2fa15 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:10.652203 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-35cd9df1-b279-4aff-9369-c00400b2fa15 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:10.652203 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-35cd9df1-b279-4aff-9369-c00400b2fa15 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:10.652203 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-35cd9df1-b279-4aff-9369-c00400b2fa15 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:10.659786 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-aae3c35d-a747-4f20-9421-e357655100f5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.329701 Jul 18 08:47:10.673852 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 57/123] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:10 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:10.949076 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-35cd9df1-b279-4aff-9369-c00400b2fa15 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:10.976321 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-35cd9df1-b279-4aff-9369-c00400b2fa15 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:10.978410 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-35cd9df1-b279-4aff-9369-c00400b2fa15 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:10.980029 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-35cd9df1-b279-4aff-9369-c00400b2fa15 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.366676 Jul 18 08:47:10.981215 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 67/124] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:10 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:47:11.073068 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2529dc0e-8a9e-41a3-8edb-81b552a3c301 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:11.074456 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2529dc0e-8a9e-41a3-8edb-81b552a3c301 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:11.102842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2529dc0e-8a9e-41a3-8edb-81b552a3c301 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:11.105013 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2529dc0e-8a9e-41a3-8edb-81b552a3c301 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:11.107056 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2529dc0e-8a9e-41a3-8edb-81b552a3c301 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:11.109085 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2529dc0e-8a9e-41a3-8edb-81b552a3c301 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:11.374646 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2529dc0e-8a9e-41a3-8edb-81b552a3c301 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:11.390425 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2529dc0e-8a9e-41a3-8edb-81b552a3c301 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.328482 Jul 18 08:47:11.391315 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 58/125] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:11 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:11.683166 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ce431ec8-89dc-40af-83c9-be3741e3005d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:11.684419 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ce431ec8-89dc-40af-83c9-be3741e3005d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:11.702900 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce431ec8-89dc-40af-83c9-be3741e3005d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:11.704068 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce431ec8-89dc-40af-83c9-be3741e3005d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:11.705909 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce431ec8-89dc-40af-83c9-be3741e3005d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:11.707293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce431ec8-89dc-40af-83c9-be3741e3005d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:12.009903 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-eb017fee-31f2-4f81-b7ff-92e56d665ee0 req-9f8e9537-3293-472f-bb34-ea6ee2196520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84de371b-4af7-43af-be6d-ed94e96dcd91", "name": "network-vif-plugged", "status": "completed", "tag": "88a52aef-93c6-4a56-800d-706ae67440c0"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:47:12.034247 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-eb017fee-31f2-4f81-b7ff-92e56d665ee0 req-9f8e9537-3293-472f-bb34-ea6ee2196520 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:12.034738 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-eb017fee-31f2-4f81-b7ff-92e56d665ee0 req-9f8e9537-3293-472f-bb34-ea6ee2196520 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:12.073122 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-eb017fee-31f2-4f81-b7ff-92e56d665ee0 req-9f8e9537-3293-472f-bb34-ea6ee2196520 service nova] Creating event network-vif-plugged:88a52aef-93c6-4a56-800d-706ae67440c0 for instance 84de371b-4af7-43af-be6d-ed94e96dcd91 on hv-cinder-85014 Jul 18 08:47:12.083558 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ce431ec8-89dc-40af-83c9-be3741e3005d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:12.085150 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-eb017fee-31f2-4f81-b7ff-92e56d665ee0 req-9f8e9537-3293-472f-bb34-ea6ee2196520 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080351 Jul 18 08:47:12.091371 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 59/126] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:47:12.097772 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d40cdd65-ab8f-460e-a2a5-0d2f5f9b9493 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:12.098753 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d40cdd65-ab8f-460e-a2a5-0d2f5f9b9493 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:12.106347 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ce431ec8-89dc-40af-83c9-be3741e3005d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.428936 Jul 18 08:47:12.107285 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 68/127] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:11 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:12.107625 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d40cdd65-ab8f-460e-a2a5-0d2f5f9b9493 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:12.108367 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d40cdd65-ab8f-460e-a2a5-0d2f5f9b9493 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:12.109489 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d40cdd65-ab8f-460e-a2a5-0d2f5f9b9493 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:12.110617 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d40cdd65-ab8f-460e-a2a5-0d2f5f9b9493 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:12.421887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7a2ee0b5-e9f6-4aaa-afdb-045deee37a11 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:12.422837 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7a2ee0b5-e9f6-4aaa-afdb-045deee37a11 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:12.467314 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a2ee0b5-e9f6-4aaa-afdb-045deee37a11 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:12.470298 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a2ee0b5-e9f6-4aaa-afdb-045deee37a11 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:12.473599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a2ee0b5-e9f6-4aaa-afdb-045deee37a11 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:12.476425 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a2ee0b5-e9f6-4aaa-afdb-045deee37a11 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:12.508289 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d40cdd65-ab8f-460e-a2a5-0d2f5f9b9493 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:12.515714 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=100 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:12.522716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d40cdd65-ab8f-460e-a2a5-0d2f5f9b9493 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:12.528646 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d40cdd65-ab8f-460e-a2a5-0d2f5f9b9493 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:12.532119 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d40cdd65-ab8f-460e-a2a5-0d2f5f9b9493 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.438453 Jul 18 08:47:12.534385 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 60/128] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:12 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:47:12.780663 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7a2ee0b5-e9f6-4aaa-afdb-045deee37a11 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:12.796474 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7a2ee0b5-e9f6-4aaa-afdb-045deee37a11 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.385838 Jul 18 08:47:12.798348 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 69/129] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:12 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:13.136509 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e358a159-7084-4140-af7b-cb670c21d917 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:13.137121 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e358a159-7084-4140-af7b-cb670c21d917 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:13.149173 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e358a159-7084-4140-af7b-cb670c21d917 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:13.149173 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e358a159-7084-4140-af7b-cb670c21d917 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:13.149173 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e358a159-7084-4140-af7b-cb670c21d917 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:13.149173 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e358a159-7084-4140-af7b-cb670c21d917 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:13.423557 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e358a159-7084-4140-af7b-cb670c21d917 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:13.434603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e358a159-7084-4140-af7b-cb670c21d917 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.301664 Jul 18 08:47:13.435317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 61/130] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:13 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:13.553274 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e1fd19c7-f6d9-4cb4-abcc-98465af4df72 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:13.553879 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e1fd19c7-f6d9-4cb4-abcc-98465af4df72 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:13.561365 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e1fd19c7-f6d9-4cb4-abcc-98465af4df72 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:13.561930 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e1fd19c7-f6d9-4cb4-abcc-98465af4df72 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:13.568850 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e1fd19c7-f6d9-4cb4-abcc-98465af4df72 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:13.568850 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e1fd19c7-f6d9-4cb4-abcc-98465af4df72 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:13.717446 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e1fd19c7-f6d9-4cb4-abcc-98465af4df72 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:13.728713 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e1fd19c7-f6d9-4cb4-abcc-98465af4df72 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:13.731634 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e1fd19c7-f6d9-4cb4-abcc-98465af4df72 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:13.740435 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e1fd19c7-f6d9-4cb4-abcc-98465af4df72 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.191022 Jul 18 08:47:13.741657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 70/131] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:13 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:47:13.819797 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-799a577b-add7-4dbc-986c-73b93adf7894 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:13.821857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-799a577b-add7-4dbc-986c-73b93adf7894 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:13.838162 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-799a577b-add7-4dbc-986c-73b93adf7894 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:13.839203 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-799a577b-add7-4dbc-986c-73b93adf7894 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:13.840937 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-799a577b-add7-4dbc-986c-73b93adf7894 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:13.842211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-799a577b-add7-4dbc-986c-73b93adf7894 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:14.042499 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-799a577b-add7-4dbc-986c-73b93adf7894 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:14.051091 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-799a577b-add7-4dbc-986c-73b93adf7894 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.238940 Jul 18 08:47:14.051709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 62/132] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:13 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:14.121994 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-56706377-0116-4c99-9052-515424ac3257 req-9de1bb0b-fd3c-4f4f-9aee-221e0157efda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866bad59-8906-4710-9fbb-63e95c376010", "name": "network-vif-plugged", "status": "completed", "tag": "47a3e70e-f8bb-43b0-84c0-a2b560f6cacd"}, {"server_uuid": "f3d6245b-0c6d-4a19-85c6-841d85912f2e", "name": "network-vif-plugged", "status": "completed", "tag": "222385f0-b84b-466b-a9f5-dab4e9dadd74"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:47:14.135499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-56706377-0116-4c99-9052-515424ac3257 req-9de1bb0b-fd3c-4f4f-9aee-221e0157efda service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:14.136466 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-56706377-0116-4c99-9052-515424ac3257 req-9de1bb0b-fd3c-4f4f-9aee-221e0157efda service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:14.151509 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-56706377-0116-4c99-9052-515424ac3257 req-9de1bb0b-fd3c-4f4f-9aee-221e0157efda service nova] Creating event network-vif-plugged:47a3e70e-f8bb-43b0-84c0-a2b560f6cacd for instance 866bad59-8906-4710-9fbb-63e95c376010 on hv-cinder-85014 Jul 18 08:47:14.152075 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-56706377-0116-4c99-9052-515424ac3257 req-9de1bb0b-fd3c-4f4f-9aee-221e0157efda service nova] Creating event network-vif-plugged:222385f0-b84b-466b-a9f5-dab4e9dadd74 for instance f3d6245b-0c6d-4a19-85c6-841d85912f2e on hv-cinder-85014 Jul 18 08:47:14.168029 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-56706377-0116-4c99-9052-515424ac3257 req-9de1bb0b-fd3c-4f4f-9aee-221e0157efda service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042387 Jul 18 08:47:14.168029 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 71/133] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:14.460533 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-76f42348-cad7-4d74-9d42-df217e9c499f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:14.461149 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-76f42348-cad7-4d74-9d42-df217e9c499f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:14.468158 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-76f42348-cad7-4d74-9d42-df217e9c499f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:14.468609 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-76f42348-cad7-4d74-9d42-df217e9c499f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:14.470136 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-76f42348-cad7-4d74-9d42-df217e9c499f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:14.470136 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-76f42348-cad7-4d74-9d42-df217e9c499f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:14.631120 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-76f42348-cad7-4d74-9d42-df217e9c499f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:14.642077 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-76f42348-cad7-4d74-9d42-df217e9c499f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1321 microversion: 2.1 time: 0.185118 Jul 18 08:47:14.643284 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 63/134] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:14 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:14.779221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0e26926e-0866-465b-a3d6-ded9303fc559 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:14.780528 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0e26926e-0866-465b-a3d6-ded9303fc559 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:14.791940 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0e26926e-0866-465b-a3d6-ded9303fc559 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:14.792638 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0e26926e-0866-465b-a3d6-ded9303fc559 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:14.793977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0e26926e-0866-465b-a3d6-ded9303fc559 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:14.794702 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0e26926e-0866-465b-a3d6-ded9303fc559 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:15.054369 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0e26926e-0866-465b-a3d6-ded9303fc559 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:15.075213 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0e26926e-0866-465b-a3d6-ded9303fc559 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:15.078429 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a25c69f7-9f93-4091-bc32-f30a013ffd31 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:15.079745 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a25c69f7-9f93-4091-bc32-f30a013ffd31 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:15.081064 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0e26926e-0866-465b-a3d6-ded9303fc559 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:15.084162 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0e26926e-0866-465b-a3d6-ded9303fc559 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.314797 Jul 18 08:47:15.086167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 72/135] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:14 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:47:15.119834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a25c69f7-9f93-4091-bc32-f30a013ffd31 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:15.120978 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a25c69f7-9f93-4091-bc32-f30a013ffd31 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:15.132814 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a25c69f7-9f93-4091-bc32-f30a013ffd31 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:15.133445 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a25c69f7-9f93-4091-bc32-f30a013ffd31 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:15.365452 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a25c69f7-9f93-4091-bc32-f30a013ffd31 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:15.375021 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a25c69f7-9f93-4091-bc32-f30a013ffd31 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.308481 Jul 18 08:47:15.376022 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 64/136] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:15 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:15.660202 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-987be1a3-00d3-4f3c-8b26-c4758433746b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:15.660903 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-987be1a3-00d3-4f3c-8b26-c4758433746b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:15.668133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-987be1a3-00d3-4f3c-8b26-c4758433746b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:15.668580 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-987be1a3-00d3-4f3c-8b26-c4758433746b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:15.669564 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-987be1a3-00d3-4f3c-8b26-c4758433746b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:15.670272 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-987be1a3-00d3-4f3c-8b26-c4758433746b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:15.818004 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-987be1a3-00d3-4f3c-8b26-c4758433746b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:15.826442 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-987be1a3-00d3-4f3c-8b26-c4758433746b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1514 microversion: 2.1 time: 0.170787 Jul 18 08:47:15.827019 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 73/137] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:15 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:15.846384 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a224bafc-545a-4ba5-85da-d2522966b774 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:47:15.847494 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a224bafc-545a-4ba5-85da-d2522966b774 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:15.853895 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a224bafc-545a-4ba5-85da-d2522966b774 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:15.854339 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a224bafc-545a-4ba5-85da-d2522966b774 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:15.855267 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a224bafc-545a-4ba5-85da-d2522966b774 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:15.855725 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a224bafc-545a-4ba5-85da-d2522966b774 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:15.927889 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-a224bafc-545a-4ba5-85da-d2522966b774 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lazy-loading 'flavor' on Instance uuid 84de371b-4af7-43af-be6d-ed94e96dcd91 {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:47:16.125029 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1aeb1cb1-8c66-4730-be2f-34da3ac76a76 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:16.126116 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1aeb1cb1-8c66-4730-be2f-34da3ac76a76 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:16.134171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1aeb1cb1-8c66-4730-be2f-34da3ac76a76 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:16.134623 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1aeb1cb1-8c66-4730-be2f-34da3ac76a76 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:16.135422 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1aeb1cb1-8c66-4730-be2f-34da3ac76a76 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:16.135939 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1aeb1cb1-8c66-4730-be2f-34da3ac76a76 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:16.322971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1aeb1cb1-8c66-4730-be2f-34da3ac76a76 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:16.334930 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a224bafc-545a-4ba5-85da-d2522966b774 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "POST /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91/action" status: 200 len: 32 microversion: 2.1 time: 0.493361 Jul 18 08:47:16.335639 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 65/138] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:47:15 2022] POST /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91/action => generated 32 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 08:47:16.352016 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1aeb1cb1-8c66-4730-be2f-34da3ac76a76 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:16.352016 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1aeb1cb1-8c66-4730-be2f-34da3ac76a76 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:16.352016 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1aeb1cb1-8c66-4730-be2f-34da3ac76a76 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.228040 Jul 18 08:47:16.352448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 74/139] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:16 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:47:16.352604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-32bcf46a-1006-4cc6-9319-36da8f92aad3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:16.352604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-32bcf46a-1006-4cc6-9319-36da8f92aad3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:16.363445 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-32bcf46a-1006-4cc6-9319-36da8f92aad3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:16.363924 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-32bcf46a-1006-4cc6-9319-36da8f92aad3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:16.371951 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-32bcf46a-1006-4cc6-9319-36da8f92aad3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:16.371951 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-32bcf46a-1006-4cc6-9319-36da8f92aad3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:16.403003 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7f28b57d-13bb-479d-9024-886fdfa9e454 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:16.404371 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7f28b57d-13bb-479d-9024-886fdfa9e454 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:16.411449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7f28b57d-13bb-479d-9024-886fdfa9e454 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:16.411944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7f28b57d-13bb-479d-9024-886fdfa9e454 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:16.412715 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7f28b57d-13bb-479d-9024-886fdfa9e454 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:16.413180 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7f28b57d-13bb-479d-9024-886fdfa9e454 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:16.587275 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-32bcf46a-1006-4cc6-9319-36da8f92aad3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:16.605686 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-32bcf46a-1006-4cc6-9319-36da8f92aad3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.262872 Jul 18 08:47:16.607757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 66/140] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:16 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:16.650993 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7f28b57d-13bb-479d-9024-886fdfa9e454 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:16.670811 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7f28b57d-13bb-479d-9024-886fdfa9e454 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1365 microversion: 2.1 time: 0.270732 Jul 18 08:47:16.673090 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 75/141] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:16 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:17.366051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b7a1cf91-5a28-4152-9d59-3c23658f9cd3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:17.366832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b7a1cf91-5a28-4152-9d59-3c23658f9cd3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:17.373819 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b7a1cf91-5a28-4152-9d59-3c23658f9cd3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:17.374511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b7a1cf91-5a28-4152-9d59-3c23658f9cd3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:17.375037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b7a1cf91-5a28-4152-9d59-3c23658f9cd3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:17.375471 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b7a1cf91-5a28-4152-9d59-3c23658f9cd3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:17.603607 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b7a1cf91-5a28-4152-9d59-3c23658f9cd3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:17.613619 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b7a1cf91-5a28-4152-9d59-3c23658f9cd3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:17.615007 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b7a1cf91-5a28-4152-9d59-3c23658f9cd3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:17.616203 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b7a1cf91-5a28-4152-9d59-3c23658f9cd3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1407 microversion: 2.20 time: 0.254128 Jul 18 08:47:17.616963 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 67/142] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:17 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:47:17.638310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-88038bc5-5b0d-48d6-9abe-3b5660f52465 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:17.639526 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-88038bc5-5b0d-48d6-9abe-3b5660f52465 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:17.647595 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-88038bc5-5b0d-48d6-9abe-3b5660f52465 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:17.648298 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-88038bc5-5b0d-48d6-9abe-3b5660f52465 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:17.649188 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-88038bc5-5b0d-48d6-9abe-3b5660f52465 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:17.650031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-88038bc5-5b0d-48d6-9abe-3b5660f52465 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:17.703870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7ef56b04-b5e4-4943-9eb9-3348a522c1c3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:17.705031 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7ef56b04-b5e4-4943-9eb9-3348a522c1c3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:17.716731 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ef56b04-b5e4-4943-9eb9-3348a522c1c3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:17.717552 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ef56b04-b5e4-4943-9eb9-3348a522c1c3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:17.718960 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ef56b04-b5e4-4943-9eb9-3348a522c1c3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:17.719843 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ef56b04-b5e4-4943-9eb9-3348a522c1c3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:17.834732 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-88038bc5-5b0d-48d6-9abe-3b5660f52465 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:17.859947 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-88038bc5-5b0d-48d6-9abe-3b5660f52465 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.226330 Jul 18 08:47:17.860658 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 76/143] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:17 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:17.912802 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7ef56b04-b5e4-4943-9eb9-3348a522c1c3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:17.921225 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7ef56b04-b5e4-4943-9eb9-3348a522c1c3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1555 microversion: 2.1 time: 0.233231 Jul 18 08:47:17.922212 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 68/144] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:17 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:17.948840 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a6fc9ffa-99d1-4c2d-933a-9f31e69bcf96 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:17.949399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a6fc9ffa-99d1-4c2d-933a-9f31e69bcf96 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:17.957083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a6fc9ffa-99d1-4c2d-933a-9f31e69bcf96 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:17.967165 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a6fc9ffa-99d1-4c2d-933a-9f31e69bcf96 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:17.967165 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a6fc9ffa-99d1-4c2d-933a-9f31e69bcf96 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:17.967165 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a6fc9ffa-99d1-4c2d-933a-9f31e69bcf96 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:18.091309 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a6fc9ffa-99d1-4c2d-933a-9f31e69bcf96 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144204 Jul 18 08:47:18.091309 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 77/145] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 08:47:17 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:18.646646 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2cedbd12-66c0-4099-8732-d451442468f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:18.647558 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2cedbd12-66c0-4099-8732-d451442468f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:18.655915 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2cedbd12-66c0-4099-8732-d451442468f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:18.656655 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2cedbd12-66c0-4099-8732-d451442468f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:18.657674 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2cedbd12-66c0-4099-8732-d451442468f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:18.658955 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2cedbd12-66c0-4099-8732-d451442468f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:18.880649 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7627e39a-b3a1-456c-a260-8b9daab20aaa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:18.881810 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7627e39a-b3a1-456c-a260-8b9daab20aaa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:18.892547 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7627e39a-b3a1-456c-a260-8b9daab20aaa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:18.893434 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7627e39a-b3a1-456c-a260-8b9daab20aaa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:18.894964 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7627e39a-b3a1-456c-a260-8b9daab20aaa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:18.895969 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7627e39a-b3a1-456c-a260-8b9daab20aaa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:19.092676 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7627e39a-b3a1-456c-a260-8b9daab20aaa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:19.102708 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7627e39a-b3a1-456c-a260-8b9daab20aaa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.227346 Jul 18 08:47:19.108310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 78/146] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:18 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:19.186653 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2cedbd12-66c0-4099-8732-d451442468f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:19.195891 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2cedbd12-66c0-4099-8732-d451442468f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:19.197460 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2cedbd12-66c0-4099-8732-d451442468f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:19.198676 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2cedbd12-66c0-4099-8732-d451442468f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1598 microversion: 2.20 time: 0.556038 Jul 18 08:47:19.200810 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 69/147] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:47:18 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1598 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:47:19.219314 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1ad7de50-1b58-4f54-929d-f4444bcce82f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:19.220184 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1ad7de50-1b58-4f54-929d-f4444bcce82f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:19.228081 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1ad7de50-1b58-4f54-929d-f4444bcce82f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:19.228689 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1ad7de50-1b58-4f54-929d-f4444bcce82f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:19.229855 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1ad7de50-1b58-4f54-929d-f4444bcce82f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:19.230625 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1ad7de50-1b58-4f54-929d-f4444bcce82f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:19.256590 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=100 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:19.354656 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1ad7de50-1b58-4f54-929d-f4444bcce82f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.140125 Jul 18 08:47:19.355272 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 79/148] 10.222.0.57 () {60 vars in 1315 bytes} [Mon Jul 18 08:47:19 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:47:20.128364 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-003256a5-a20d-4262-b189-94aa1139da8b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:20.129490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-003256a5-a20d-4262-b189-94aa1139da8b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:20.136691 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-003256a5-a20d-4262-b189-94aa1139da8b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:20.137233 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-003256a5-a20d-4262-b189-94aa1139da8b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:20.138107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-003256a5-a20d-4262-b189-94aa1139da8b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:20.138550 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-003256a5-a20d-4262-b189-94aa1139da8b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:20.766505 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-003256a5-a20d-4262-b189-94aa1139da8b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:20.785461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-003256a5-a20d-4262-b189-94aa1139da8b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.661665 Jul 18 08:47:20.801239 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 70/149] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:20 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:20.801465 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-b12891e6-42fe-4891-b8fe-06b060de044f req-3dd94665-19f3-4448-94a4-ac3e020e37ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866bad59-8906-4710-9fbb-63e95c376010", "tag": "47a3e70e-f8bb-43b0-84c0-a2b560f6cacd"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:47:20.835134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-b12891e6-42fe-4891-b8fe-06b060de044f req-3dd94665-19f3-4448-94a4-ac3e020e37ad service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:20.844091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-b12891e6-42fe-4891-b8fe-06b060de044f req-3dd94665-19f3-4448-94a4-ac3e020e37ad service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:20.888697 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-b12891e6-42fe-4891-b8fe-06b060de044f req-3dd94665-19f3-4448-94a4-ac3e020e37ad service nova] Creating event network-changed:47a3e70e-f8bb-43b0-84c0-a2b560f6cacd for instance 866bad59-8906-4710-9fbb-63e95c376010 on hv-cinder-85014 Jul 18 08:47:20.902046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-b12891e6-42fe-4891-b8fe-06b060de044f req-3dd94665-19f3-4448-94a4-ac3e020e37ad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109321 Jul 18 08:47:20.904389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 80/150] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:47:21.604094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-e019aa9f-c60d-4e3c-a3e5-e3375783eb00 req-e3c183cb-bcbc-4cba-b5b4-1c1967765078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d6245b-0c6d-4a19-85c6-841d85912f2e", "tag": "222385f0-b84b-466b-a9f5-dab4e9dadd74"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:47:21.620551 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-e019aa9f-c60d-4e3c-a3e5-e3375783eb00 req-e3c183cb-bcbc-4cba-b5b4-1c1967765078 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:21.621015 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-e019aa9f-c60d-4e3c-a3e5-e3375783eb00 req-e3c183cb-bcbc-4cba-b5b4-1c1967765078 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:21.645147 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-e019aa9f-c60d-4e3c-a3e5-e3375783eb00 req-e3c183cb-bcbc-4cba-b5b4-1c1967765078 service nova] Creating event network-changed:222385f0-b84b-466b-a9f5-dab4e9dadd74 for instance f3d6245b-0c6d-4a19-85c6-841d85912f2e on hv-cinder-85014 Jul 18 08:47:21.651056 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-e019aa9f-c60d-4e3c-a3e5-e3375783eb00 req-e3c183cb-bcbc-4cba-b5b4-1c1967765078 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052546 Jul 18 08:47:21.661355 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 71/151] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:47:21.817890 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bfaa23c4-2592-42df-9541-66b4bcd525c6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:21.819623 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bfaa23c4-2592-42df-9541-66b4bcd525c6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:21.836143 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bfaa23c4-2592-42df-9541-66b4bcd525c6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:21.836609 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bfaa23c4-2592-42df-9541-66b4bcd525c6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:21.841356 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bfaa23c4-2592-42df-9541-66b4bcd525c6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:21.842280 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bfaa23c4-2592-42df-9541-66b4bcd525c6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:22.279475 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0cfa7715-23c1-4c32-a3bf-8d4492776aa5 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:22.280505 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0cfa7715-23c1-4c32-a3bf-8d4492776aa5 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:22.293463 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0cfa7715-23c1-4c32-a3bf-8d4492776aa5 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:22.294885 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0cfa7715-23c1-4c32-a3bf-8d4492776aa5 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:22.298356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0cfa7715-23c1-4c32-a3bf-8d4492776aa5 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:22.299231 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0cfa7715-23c1-4c32-a3bf-8d4492776aa5 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:22.385383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0cfa7715-23c1-4c32-a3bf-8d4492776aa5 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Going to try to terminate instance {{(pid=124895) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:47:22.663039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bfaa23c4-2592-42df-9541-66b4bcd525c6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:22.679842 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bfaa23c4-2592-42df-9541-66b4bcd525c6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.874382 Jul 18 08:47:22.680825 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 81/152] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:21 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:23.005270 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0cfa7715-23c1-4c32-a3bf-8d4492776aa5 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 204 len: 0 microversion: 2.1 time: 0.730199 Jul 18 08:47:23.007596 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 72/153] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:47:22 2022] DELETE /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:47:23.021580 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-95592253-c0c2-4d66-b6f7-0db36e30dc98 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:23.023011 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-95592253-c0c2-4d66-b6f7-0db36e30dc98 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:23.036138 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-95592253-c0c2-4d66-b6f7-0db36e30dc98 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:23.038150 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-95592253-c0c2-4d66-b6f7-0db36e30dc98 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:23.040074 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-95592253-c0c2-4d66-b6f7-0db36e30dc98 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:23.045666 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-95592253-c0c2-4d66-b6f7-0db36e30dc98 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:23.262278 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-95592253-c0c2-4d66-b6f7-0db36e30dc98 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:23.279600 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-95592253-c0c2-4d66-b6f7-0db36e30dc98 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1555 microversion: 2.1 time: 0.265898 Jul 18 08:47:23.281576 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 82/154] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:23 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1555 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:23.705837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-46480903-2017-42cd-a4ea-657bd41e03f4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:23.710041 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-46480903-2017-42cd-a4ea-657bd41e03f4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:23.721421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-46480903-2017-42cd-a4ea-657bd41e03f4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:23.722071 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-46480903-2017-42cd-a4ea-657bd41e03f4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:23.723636 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-46480903-2017-42cd-a4ea-657bd41e03f4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:23.724587 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-46480903-2017-42cd-a4ea-657bd41e03f4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:23.917461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-46480903-2017-42cd-a4ea-657bd41e03f4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:23.927365 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-46480903-2017-42cd-a4ea-657bd41e03f4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.232588 Jul 18 08:47:23.928816 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 73/155] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:23 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:24.303097 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ebd8011d-07e5-4e2e-98d6-326e90129278 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:24.303942 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ebd8011d-07e5-4e2e-98d6-326e90129278 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:24.312235 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ebd8011d-07e5-4e2e-98d6-326e90129278 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:24.312683 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ebd8011d-07e5-4e2e-98d6-326e90129278 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:24.313515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ebd8011d-07e5-4e2e-98d6-326e90129278 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:24.313946 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ebd8011d-07e5-4e2e-98d6-326e90129278 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:24.507205 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ebd8011d-07e5-4e2e-98d6-326e90129278 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:24.524719 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ebd8011d-07e5-4e2e-98d6-326e90129278 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1555 microversion: 2.1 time: 0.225391 Jul 18 08:47:24.525678 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 83/156] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:24 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:24.945846 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-286a49b9-f48e-417b-a336-83808e9d36f8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:24.946456 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-286a49b9-f48e-417b-a336-83808e9d36f8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:24.954261 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-286a49b9-f48e-417b-a336-83808e9d36f8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:24.954719 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-286a49b9-f48e-417b-a336-83808e9d36f8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:24.955473 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-286a49b9-f48e-417b-a336-83808e9d36f8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:24.955982 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-286a49b9-f48e-417b-a336-83808e9d36f8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:24.972850 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:25.150291 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-286a49b9-f48e-417b-a336-83808e9d36f8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:25.158782 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-286a49b9-f48e-417b-a336-83808e9d36f8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.216701 Jul 18 08:47:25.159373 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 74/157] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:24 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:25.554889 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-39e9d21a-a691-455e-b632-e2eb7145d915 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:25.556069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-39e9d21a-a691-455e-b632-e2eb7145d915 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:25.563382 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39e9d21a-a691-455e-b632-e2eb7145d915 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:25.563957 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39e9d21a-a691-455e-b632-e2eb7145d915 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:25.564805 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39e9d21a-a691-455e-b632-e2eb7145d915 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:25.565572 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39e9d21a-a691-455e-b632-e2eb7145d915 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:25.737800 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-39e9d21a-a691-455e-b632-e2eb7145d915 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:25.756490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-39e9d21a-a691-455e-b632-e2eb7145d915 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1555 microversion: 2.1 time: 0.202615 Jul 18 08:47:25.756490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 84/158] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:25 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:26.180961 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-bd3d8130-bd26-49de-b941-d583f37ec6e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:26.182135 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-bd3d8130-bd26-49de-b941-d583f37ec6e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:26.195154 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bd3d8130-bd26-49de-b941-d583f37ec6e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:26.195991 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bd3d8130-bd26-49de-b941-d583f37ec6e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:26.200927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bd3d8130-bd26-49de-b941-d583f37ec6e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:26.200927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bd3d8130-bd26-49de-b941-d583f37ec6e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:26.363263 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-bd3d8130-bd26-49de-b941-d583f37ec6e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:26.370946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-bd3d8130-bd26-49de-b941-d583f37ec6e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.198019 Jul 18 08:47:26.371518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 75/159] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:26 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:26.777983 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f5478a69-8407-483d-aad4-787bc58d3c3b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:26.779307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f5478a69-8407-483d-aad4-787bc58d3c3b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:26.786372 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f5478a69-8407-483d-aad4-787bc58d3c3b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:26.786849 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f5478a69-8407-483d-aad4-787bc58d3c3b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:26.787582 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f5478a69-8407-483d-aad4-787bc58d3c3b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:26.788040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f5478a69-8407-483d-aad4-787bc58d3c3b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:26.974812 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f5478a69-8407-483d-aad4-787bc58d3c3b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:27.343876 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f5478a69-8407-483d-aad4-787bc58d3c3b tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1555 microversion: 2.1 time: 0.216453 Jul 18 08:47:27.343876 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 85/160] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:26 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:27.391049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a867ba94-a18d-4f03-95c1-39ca4cb786f0 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:27.391927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a867ba94-a18d-4f03-95c1-39ca4cb786f0 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:27.398540 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a867ba94-a18d-4f03-95c1-39ca4cb786f0 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:27.398994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a867ba94-a18d-4f03-95c1-39ca4cb786f0 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:27.399812 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a867ba94-a18d-4f03-95c1-39ca4cb786f0 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:27.400243 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a867ba94-a18d-4f03-95c1-39ca4cb786f0 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:27.642542 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a867ba94-a18d-4f03-95c1-39ca4cb786f0 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:27.642542 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a867ba94-a18d-4f03-95c1-39ca4cb786f0 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.254674 Jul 18 08:47:27.642542 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 76/161] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:27 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:28.009297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-de8009bf-f488-486f-8ead-8c69331504f0 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:28.010096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-de8009bf-f488-486f-8ead-8c69331504f0 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:28.034591 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-de8009bf-f488-486f-8ead-8c69331504f0 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:28.034591 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-de8009bf-f488-486f-8ead-8c69331504f0 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:28.034591 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-de8009bf-f488-486f-8ead-8c69331504f0 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:28.034591 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-de8009bf-f488-486f-8ead-8c69331504f0 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:28.599610 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-de8009bf-f488-486f-8ead-8c69331504f0 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:28.609813 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-de8009bf-f488-486f-8ead-8c69331504f0 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1555 microversion: 2.1 time: 0.604477 Jul 18 08:47:28.610828 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 86/162] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:28 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1555 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:28.662115 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2adddf15-d158-4973-94eb-065d59230c5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:28.668054 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2adddf15-d158-4973-94eb-065d59230c5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:28.678794 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2adddf15-d158-4973-94eb-065d59230c5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:28.680642 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2adddf15-d158-4973-94eb-065d59230c5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:28.682443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2adddf15-d158-4973-94eb-065d59230c5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:28.683950 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2adddf15-d158-4973-94eb-065d59230c5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:28.951030 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2adddf15-d158-4973-94eb-065d59230c5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:28.977323 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-febe8f5a-d77e-424f-95ec-cf0c6a417b61 req-6d8209c1-3d29-4661-b724-95b0761c77c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efda553-6895-4088-a371-4c3d6fb05969", "name": "network-vif-deleted", "tag": "b8385ec2-63dc-4baa-baa7-44b6b21c02d5"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:47:28.990279 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2adddf15-d158-4973-94eb-065d59230c5a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.334756 Jul 18 08:47:28.993812 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 77/163] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:28 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:28.997413 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-febe8f5a-d77e-424f-95ec-cf0c6a417b61 req-6d8209c1-3d29-4661-b724-95b0761c77c4 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:28.998280 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-febe8f5a-d77e-424f-95ec-cf0c6a417b61 req-6d8209c1-3d29-4661-b724-95b0761c77c4 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:29.014457 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-febe8f5a-d77e-424f-95ec-cf0c6a417b61 req-6d8209c1-3d29-4661-b724-95b0761c77c4 service nova] Creating event network-vif-deleted:b8385ec2-63dc-4baa-baa7-44b6b21c02d5 for instance 9efda553-6895-4088-a371-4c3d6fb05969 on hv-cinder-85014 Jul 18 08:47:29.020818 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-febe8f5a-d77e-424f-95ec-cf0c6a417b61 req-6d8209c1-3d29-4661-b724-95b0761c77c4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052576 Jul 18 08:47:29.021440 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 87/164] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:29.628063 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-83e8a1b1-cba6-4db8-867a-970215aa8a19 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:29.628677 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-83e8a1b1-cba6-4db8-867a-970215aa8a19 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:29.635083 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-83e8a1b1-cba6-4db8-867a-970215aa8a19 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:29.635580 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-83e8a1b1-cba6-4db8-867a-970215aa8a19 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:29.636389 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-83e8a1b1-cba6-4db8-867a-970215aa8a19 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:29.636822 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-83e8a1b1-cba6-4db8-867a-970215aa8a19 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:29.702359 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-83e8a1b1-cba6-4db8-867a-970215aa8a19 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a5cc6144c0434b9f16fb050c4c7662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a773b75a4b4442ca01dc2b0d9e4e5d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:29.711522 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-83e8a1b1-cba6-4db8-867a-970215aa8a19 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 200 len: 1346 microversion: 2.1 time: 0.087427 Jul 18 08:47:29.712137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 78/165] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:29 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:30.048876 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1c05639c-e62d-4ac3-9cb5-8023a4eab8d8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:30.049787 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1c05639c-e62d-4ac3-9cb5-8023a4eab8d8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:30.058432 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c05639c-e62d-4ac3-9cb5-8023a4eab8d8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:30.059027 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c05639c-e62d-4ac3-9cb5-8023a4eab8d8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:30.060433 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c05639c-e62d-4ac3-9cb5-8023a4eab8d8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:30.061302 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c05639c-e62d-4ac3-9cb5-8023a4eab8d8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:30.212554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1c05639c-e62d-4ac3-9cb5-8023a4eab8d8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:30.227261 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1c05639c-e62d-4ac3-9cb5-8023a4eab8d8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.209638 Jul 18 08:47:30.228416 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 88/166] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:30 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:30.728986 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d07c4d29-1484-4fe8-80bb-ae973305ab83 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:30.729581 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d07c4d29-1484-4fe8-80bb-ae973305ab83 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:30.737708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d07c4d29-1484-4fe8-80bb-ae973305ab83 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:30.738150 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d07c4d29-1484-4fe8-80bb-ae973305ab83 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:30.739001 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d07c4d29-1484-4fe8-80bb-ae973305ab83 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:30.739424 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d07c4d29-1484-4fe8-80bb-ae973305ab83 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:30.757703 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-d07c4d29-1484-4fe8-80bb-ae973305ab83 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] HTTP exception thrown: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d07c4d29-1484-4fe8-80bb-ae973305ab83 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Request method failure captured: Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 HTTP/1.1 Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3Wd-wqATo0ua-PvViIZjqrbNk5UTPa-IntT4gGbJ8ZFJd7Kru4StuIRnmjsJ1NnvgQcwRqfmXbiKYXVZd-uVk0zetcwSP8oeKrEMAMrCFzfpjh6IGISKsM11PrhYFK6h33n9--PEuho1NVkGcDXVP5SKeEjn6bEhPxeMt5qotS6E0 Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: 4a773b75a4b4442ca01dc2b0d9e4e5d9 Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:47:30.763795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a773b75a4b4442ca01dc2b0d9e4e5d9", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: 4a773b75a4b4442ca01dc2b0d9e4e5d9 Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-DeleteServersTestJSON-1755941998-project Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 67a5cc6144c0434b9f16fb050c4c7662 Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-DeleteServersTestJSON-1755941998-project Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:30.765799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': '9efda553-6895-4088-a371-4c3d6fb05969'} Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:47:30.767037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:30.768842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:30.770984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d07c4d29-1484-4fe8-80bb-ae973305ab83 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Returning 404 to user: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:47:30.770984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d07c4d29-1484-4fe8-80bb-ae973305ab83 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 404 len: 111 microversion: 2.1 time: 0.040489 Jul 18 08:47:30.770984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 79/167] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:30 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:47:30.882799 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ba7c8ab6-05ca-40a0-a4a9-3170160ba505 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:30.883796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ba7c8ab6-05ca-40a0-a4a9-3170160ba505 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:30.891966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba7c8ab6-05ca-40a0-a4a9-3170160ba505 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:30.892413 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba7c8ab6-05ca-40a0-a4a9-3170160ba505 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:30.894096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba7c8ab6-05ca-40a0-a4a9-3170160ba505 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:30.894096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba7c8ab6-05ca-40a0-a4a9-3170160ba505 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:30.909063 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-ba7c8ab6-05ca-40a0-a4a9-3170160ba505 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] HTTP exception thrown: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ba7c8ab6-05ca-40a0-a4a9-3170160ba505 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Request method failure captured: Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969/os-volume_attachments HTTP/1.1 Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3Wd-wqATo0ua-PvViIZjqrbNk5UTPa-IntT4gGbJ8ZFJd7Kru4StuIRnmjsJ1NnvgQcwRqfmXbiKYXVZd-uVk0zetcwSP8oeKrEMAMrCFzfpjh6IGISKsM11PrhYFK6h33n9--PEuho1NVkGcDXVP5SKeEjn6bEhPxeMt5qotS6E0 Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: 4a773b75a4b4442ca01dc2b0d9e4e5d9 Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:47:30.914134 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a773b75a4b4442ca01dc2b0d9e4e5d9", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: 4a773b75a4b4442ca01dc2b0d9e4e5d9 Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-DeleteServersTestJSON-1755941998-project Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 67a5cc6144c0434b9f16fb050c4c7662 Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-DeleteServersTestJSON-1755941998-project Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:30.915717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'server_id': '9efda553-6895-4088-a371-4c3d6fb05969'} Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:47:30.916495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:30.917671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:47:30.919451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ba7c8ab6-05ca-40a0-a4a9-3170160ba505 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Returning 404 to user: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:47:30.919451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ba7c8ab6-05ca-40a0-a4a9-3170160ba505 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037055 Jul 18 08:47:30.919451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 89/168] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:47:30 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:47:31.252754 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7863c4c0-3121-403c-a2ec-fdcc5f26cdfc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:31.253290 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7863c4c0-3121-403c-a2ec-fdcc5f26cdfc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:31.260054 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7863c4c0-3121-403c-a2ec-fdcc5f26cdfc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:31.260505 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7863c4c0-3121-403c-a2ec-fdcc5f26cdfc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:31.261292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7863c4c0-3121-403c-a2ec-fdcc5f26cdfc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:31.261733 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7863c4c0-3121-403c-a2ec-fdcc5f26cdfc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:31.493801 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7863c4c0-3121-403c-a2ec-fdcc5f26cdfc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:31.504862 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7863c4c0-3121-403c-a2ec-fdcc5f26cdfc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.255982 Jul 18 08:47:31.505406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 80/169] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:31 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:32.458576 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-631209cb-348c-4e5b-a04e-0e304f806fa6 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:32.459280 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-631209cb-348c-4e5b-a04e-0e304f806fa6 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:32.466949 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-631209cb-348c-4e5b-a04e-0e304f806fa6 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:32.467608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-631209cb-348c-4e5b-a04e-0e304f806fa6 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:32.468429 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-631209cb-348c-4e5b-a04e-0e304f806fa6 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:32.468869 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-631209cb-348c-4e5b-a04e-0e304f806fa6 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:32.484477 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-631209cb-348c-4e5b-a04e-0e304f806fa6 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] HTTP exception thrown: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-631209cb-348c-4e5b-a04e-0e304f806fa6 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Request method failure captured: Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: DELETE /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 HTTP/1.1 Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3Wd-wqATo0ua-PvViIZjqrbNk5UTPa-IntT4gGbJ8ZFJd7Kru4StuIRnmjsJ1NnvgQcwRqfmXbiKYXVZd-uVk0zetcwSP8oeKrEMAMrCFzfpjh6IGISKsM11PrhYFK6h33n9--PEuho1NVkGcDXVP5SKeEjn6bEhPxeMt5qotS6E0 Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: 4a773b75a4b4442ca01dc2b0d9e4e5d9 Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:47:32.486690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a773b75a4b4442ca01dc2b0d9e4e5d9", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: 4a773b75a4b4442ca01dc2b0d9e4e5d9 Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-DeleteServersTestJSON-1755941998-project Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 67a5cc6144c0434b9f16fb050c4c7662 Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-DeleteServersTestJSON-1755941998-project Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:32.488315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '9efda553-6895-4088-a371-4c3d6fb05969'} Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:47:32.488954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:32.489982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:47:32.491099 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-631209cb-348c-4e5b-a04e-0e304f806fa6 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Returning 404 to user: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:47:32.491099 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-631209cb-348c-4e5b-a04e-0e304f806fa6 tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 404 len: 111 microversion: 2.1 time: 0.033688 Jul 18 08:47:32.491099 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 90/170] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:47:32 2022] DELETE /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:47:32.497196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-44f7805f-9c8e-4aff-8447-a244c4db386f tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:32.497935 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-44f7805f-9c8e-4aff-8447-a244c4db386f tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] [instance: 9efda553-6895-4088-a371-4c3d6fb05969] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:32.504185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-44f7805f-9c8e-4aff-8447-a244c4db386f tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:32.504627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-44f7805f-9c8e-4aff-8447-a244c4db386f tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:32.505398 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-44f7805f-9c8e-4aff-8447-a244c4db386f tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:32.505829 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-44f7805f-9c8e-4aff-8447-a244c4db386f tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:32.520360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-44f7805f-9c8e-4aff-8447-a244c4db386f tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] HTTP exception thrown: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-44f7805f-9c8e-4aff-8447-a244c4db386f tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Request method failure captured: Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 HTTP/1.1 Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3Wd-wqATo0ua-PvViIZjqrbNk5UTPa-IntT4gGbJ8ZFJd7Kru4StuIRnmjsJ1NnvgQcwRqfmXbiKYXVZd-uVk0zetcwSP8oeKrEMAMrCFzfpjh6IGISKsM11PrhYFK6h33n9--PEuho1NVkGcDXVP5SKeEjn6bEhPxeMt5qotS6E0 Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: 4a773b75a4b4442ca01dc2b0d9e4e5d9 Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:47:32.521902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4a773b75a4b4442ca01dc2b0d9e4e5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4a773b75a4b4442ca01dc2b0d9e4e5d9", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: 4a773b75a4b4442ca01dc2b0d9e4e5d9 Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-DeleteServersTestJSON-1755941998 Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-DeleteServersTestJSON-1755941998-project Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 67a5cc6144c0434b9f16fb050c4c7662 Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-DeleteServersTestJSON-1755941998-project Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:32.523319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': '9efda553-6895-4088-a371-4c3d6fb05969'} Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:47:32.524224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. Jul 18 08:47:32.525493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:32.526909 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-44f7805f-9c8e-4aff-8447-a244c4db386f tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] Returning 404 to user: Instance 9efda553-6895-4088-a371-4c3d6fb05969 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:47:32.527053 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3740a434-8c76-4cc4-8f69-3589dfff75bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:32.527231 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-44f7805f-9c8e-4aff-8447-a244c4db386f tempest-DeleteServersTestJSON-1755941998 tempest-DeleteServersTestJSON-1755941998-project] 10.222.0.57 "GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969" status: 404 len: 111 microversion: 2.1 time: 0.030227 Jul 18 08:47:32.527501 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-3740a434-8c76-4cc4-8f69-3589dfff75bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:32.527653 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 81/171] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:32 2022] GET /compute/v2.1/servers/9efda553-6895-4088-a371-4c3d6fb05969 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:47:32.531488 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3740a434-8c76-4cc4-8f69-3589dfff75bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:32.531984 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3740a434-8c76-4cc4-8f69-3589dfff75bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:32.533299 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3740a434-8c76-4cc4-8f69-3589dfff75bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:32.533744 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3740a434-8c76-4cc4-8f69-3589dfff75bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:32.688161 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-3740a434-8c76-4cc4-8f69-3589dfff75bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:32.697497 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-3740a434-8c76-4cc4-8f69-3589dfff75bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.178679 Jul 18 08:47:32.698925 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 91/172] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:32 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:33.719547 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2d108e5a-dd9b-4258-bf4a-53b0d83bf913 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:33.730895 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2d108e5a-dd9b-4258-bf4a-53b0d83bf913 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:33.781499 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2d108e5a-dd9b-4258-bf4a-53b0d83bf913 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:33.786638 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2d108e5a-dd9b-4258-bf4a-53b0d83bf913 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:33.788072 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2d108e5a-dd9b-4258-bf4a-53b0d83bf913 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:33.788784 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2d108e5a-dd9b-4258-bf4a-53b0d83bf913 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:34.123256 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2d108e5a-dd9b-4258-bf4a-53b0d83bf913 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:34.132321 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2d108e5a-dd9b-4258-bf4a-53b0d83bf913 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.419064 Jul 18 08:47:34.144457 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 82/173] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:33 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:35.153610 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-420664b2-21aa-43cf-8211-85342594f0df tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:35.154874 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-420664b2-21aa-43cf-8211-85342594f0df tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:35.164111 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-420664b2-21aa-43cf-8211-85342594f0df tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:35.164734 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-420664b2-21aa-43cf-8211-85342594f0df tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:35.167299 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-420664b2-21aa-43cf-8211-85342594f0df tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:35.167299 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-420664b2-21aa-43cf-8211-85342594f0df tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:35.407697 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-420664b2-21aa-43cf-8211-85342594f0df tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:35.423118 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-420664b2-21aa-43cf-8211-85342594f0df tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.270705 Jul 18 08:47:35.424379 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 92/174] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:35 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:36.456490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8c406270-24fb-4f38-a7e8-75b69a1c4bc5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:36.459855 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8c406270-24fb-4f38-a7e8-75b69a1c4bc5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:36.487717 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8c406270-24fb-4f38-a7e8-75b69a1c4bc5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:36.491107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8c406270-24fb-4f38-a7e8-75b69a1c4bc5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:36.493815 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8c406270-24fb-4f38-a7e8-75b69a1c4bc5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:36.498365 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8c406270-24fb-4f38-a7e8-75b69a1c4bc5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:36.940730 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-8c406270-24fb-4f38-a7e8-75b69a1c4bc5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:36.957003 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8c406270-24fb-4f38-a7e8-75b69a1c4bc5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.509408 Jul 18 08:47:36.960497 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 83/175] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:36 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:38.011132 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-614da239-89e8-4257-a43e-a18a41144090 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:38.012183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-614da239-89e8-4257-a43e-a18a41144090 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:38.023818 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-614da239-89e8-4257-a43e-a18a41144090 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:38.024565 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-614da239-89e8-4257-a43e-a18a41144090 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:38.026435 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-614da239-89e8-4257-a43e-a18a41144090 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:38.027641 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-614da239-89e8-4257-a43e-a18a41144090 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:38.359509 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-614da239-89e8-4257-a43e-a18a41144090 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:38.369022 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-614da239-89e8-4257-a43e-a18a41144090 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.375166 Jul 18 08:47:38.392060 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 93/176] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:37 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:39.412271 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2e67ca78-fc4f-4f32-b359-e01c97dc6c33 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:39.412271 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2e67ca78-fc4f-4f32-b359-e01c97dc6c33 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:39.419764 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2e67ca78-fc4f-4f32-b359-e01c97dc6c33 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:39.420959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2e67ca78-fc4f-4f32-b359-e01c97dc6c33 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:39.423703 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2e67ca78-fc4f-4f32-b359-e01c97dc6c33 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:39.424551 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2e67ca78-fc4f-4f32-b359-e01c97dc6c33 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:39.610110 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2e67ca78-fc4f-4f32-b359-e01c97dc6c33 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:39.625556 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2e67ca78-fc4f-4f32-b359-e01c97dc6c33 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.225492 Jul 18 08:47:39.626498 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 84/177] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:39 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:40.645546 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-4a170fa1-312a-44d2-b0f1-0eed9d8c6778 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:40.646333 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-4a170fa1-312a-44d2-b0f1-0eed9d8c6778 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:40.650148 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=58 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:40.654149 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4a170fa1-312a-44d2-b0f1-0eed9d8c6778 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:40.654810 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4a170fa1-312a-44d2-b0f1-0eed9d8c6778 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:40.655648 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4a170fa1-312a-44d2-b0f1-0eed9d8c6778 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:40.656343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4a170fa1-312a-44d2-b0f1-0eed9d8c6778 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:40.855877 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-4a170fa1-312a-44d2-b0f1-0eed9d8c6778 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:40.864186 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-4a170fa1-312a-44d2-b0f1-0eed9d8c6778 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.223006 Jul 18 08:47:40.864186 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 94/178] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:40 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:41.499559 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-42009a3b-658b-4059-b792-9ac2533b56e2 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] Action: 'create', calling method: .version_select at 0x7fafb7d18f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1107017456", "metadata": {"Type": "work"}}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:47:41.884667 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e6944783-7d9c-47d9-b617-a373887eb585 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:41.886907 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e6944783-7d9c-47d9-b617-a373887eb585 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:41.897652 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e6944783-7d9c-47d9-b617-a373887eb585 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:41.898251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e6944783-7d9c-47d9-b617-a373887eb585 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:41.899441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e6944783-7d9c-47d9-b617-a373887eb585 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:41.900200 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e6944783-7d9c-47d9-b617-a373887eb585 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:42.063043 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e6944783-7d9c-47d9-b617-a373887eb585 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:42.071008 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e6944783-7d9c-47d9-b617-a373887eb585 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.192790 Jul 18 08:47:42.071606 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 95/179] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:41 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:42.490987 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-42009a3b-658b-4059-b792-9ac2533b56e2 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.145107 Jul 18 08:47:42.499843 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 85/180] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Jul 18 08:47:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1148 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 08:47:42.508473 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f824463e-ff7b-4111-8a32-5462eb296fef tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] Calling method '.version_select at 0x7fafb74630d0>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:42.597208 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f824463e-ff7b-4111-8a32-5462eb296fef tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5" status: 200 len: 353 microversion: 2.1 time: 0.092526 Jul 18 08:47:42.597999 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 96/181] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:47:42 2022] GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:43.089537 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-db209736-bfd4-4e91-83bf-4df9adc4c07e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:43.090155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-db209736-bfd4-4e91-83bf-4df9adc4c07e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:43.093497 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:43.098769 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-db209736-bfd4-4e91-83bf-4df9adc4c07e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:43.099221 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-db209736-bfd4-4e91-83bf-4df9adc4c07e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:43.100023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-db209736-bfd4-4e91-83bf-4df9adc4c07e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:43.100457 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-db209736-bfd4-4e91-83bf-4df9adc4c07e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:43.272313 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-db209736-bfd4-4e91-83bf-4df9adc4c07e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:43.284731 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-db209736-bfd4-4e91-83bf-4df9adc4c07e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.198782 Jul 18 08:47:43.285955 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 86/182] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:43 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:43.611282 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-22dcc028-b3b7-44c5-b098-f20f6d02b375 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] Calling method '.version_select at 0x7fafb74b9d30>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:43.662137 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-22dcc028-b3b7-44c5-b098-f20f6d02b375 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5" status: 200 len: 353 microversion: 2.1 time: 0.055619 Jul 18 08:47:43.662784 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 97/183] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:47:43 2022] GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:47:44.302763 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8cd0e53c-5068-4ab6-bf09-84f469e2b639 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:44.303811 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8cd0e53c-5068-4ab6-bf09-84f469e2b639 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:44.311147 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cd0e53c-5068-4ab6-bf09-84f469e2b639 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:44.311630 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cd0e53c-5068-4ab6-bf09-84f469e2b639 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:44.312651 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cd0e53c-5068-4ab6-bf09-84f469e2b639 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:44.313185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cd0e53c-5068-4ab6-bf09-84f469e2b639 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:44.466457 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-8cd0e53c-5068-4ab6-bf09-84f469e2b639 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:44.474143 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8cd0e53c-5068-4ab6-bf09-84f469e2b639 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.175434 Jul 18 08:47:44.474726 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 87/184] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:44 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:44.676150 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d5ed7114-c862-4976-96b3-4a716cd654a9 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] Calling method '.version_select at 0x7fafb7467430>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:44.732112 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d5ed7114-c862-4976-96b3-4a716cd654a9 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5" status: 200 len: 353 microversion: 2.1 time: 0.060477 Jul 18 08:47:44.732957 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 98/185] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:47:44 2022] GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:45.494355 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9e447c9c-2a12-4eee-95b0-063f365e6ba7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:45.496301 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9e447c9c-2a12-4eee-95b0-063f365e6ba7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:45.512867 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9e447c9c-2a12-4eee-95b0-063f365e6ba7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:45.513676 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9e447c9c-2a12-4eee-95b0-063f365e6ba7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:45.514874 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9e447c9c-2a12-4eee-95b0-063f365e6ba7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:45.515609 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9e447c9c-2a12-4eee-95b0-063f365e6ba7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:45.710288 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9e447c9c-2a12-4eee-95b0-063f365e6ba7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:45.720889 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9e447c9c-2a12-4eee-95b0-063f365e6ba7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.233260 Jul 18 08:47:45.730669 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 88/186] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:45 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:45.747187 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9bf4da53-15e8-4124-bbdc-206ed346903a tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] Calling method '.version_select at 0x7fafb758e670>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:45.797006 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9bf4da53-15e8-4124-bbdc-206ed346903a tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5" status: 200 len: 354 microversion: 2.1 time: 0.055694 Jul 18 08:47:45.797718 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 99/187] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:47:45 2022] GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:45.816240 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b5598105-c818-48d2-8920-c6198c82eef0 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] Calling method '.version_select at 0x7fafb7c851f0>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:45.915697 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b5598105-c818-48d2-8920-c6198c82eef0 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5" status: 200 len: 354 microversion: 2.1 time: 0.107331 Jul 18 08:47:45.927380 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 89/188] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:47:45 2022] GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:45.951517 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-96cbe04a-8326-47c7-9562-ce064905b335 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] Calling method '.version_select at 0x7fafb7463d30>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:46.396272 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-96cbe04a-8326-47c7-9562-ce064905b335 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5" status: 202 len: 0 microversion: 2.1 time: 0.453767 Jul 18 08:47:46.400070 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 100/189] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 08:47:45 2022] DELETE /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:47:46.406754 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0f60292d-75b2-461d-80aa-cf706be8fb6b tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] Calling method '.version_select at 0x7fafb7c85a60>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:46.475697 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0f60292d-75b2-461d-80aa-cf706be8fb6b tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5" status: 200 len: 353 microversion: 2.1 time: 0.073620 Jul 18 08:47:46.476368 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 90/190] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:47:46 2022] GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:46.741805 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ad6f529b-a6ed-4c50-9de6-707af68bd0de tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:46.743799 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ad6f529b-a6ed-4c50-9de6-707af68bd0de tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:46.759625 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ad6f529b-a6ed-4c50-9de6-707af68bd0de tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:46.760762 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ad6f529b-a6ed-4c50-9de6-707af68bd0de tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:46.763261 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ad6f529b-a6ed-4c50-9de6-707af68bd0de tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:46.764401 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ad6f529b-a6ed-4c50-9de6-707af68bd0de tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:46.956146 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ad6f529b-a6ed-4c50-9de6-707af68bd0de tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:46.968471 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ad6f529b-a6ed-4c50-9de6-707af68bd0de tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.232933 Jul 18 08:47:46.969487 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 101/191] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:46 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:47.489037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-864010d3-accb-4fee-b30e-96d4dc3c6472 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] Calling method '.version_select at 0x7fafb7cf20d0>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:47.525650 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-864010d3-accb-4fee-b30e-96d4dc3c6472 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] HTTP exception thrown: Volume 7531a049-43bf-4a8d-b68d-ccc685f9f1f5 could not be found. Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-864010d3-accb-4fee-b30e-96d4dc3c6472 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] Request method failure captured: Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5 HTTP/1.1 Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R4tl1L0u2Hqr8OyLh6lHKWp3yJyeVD7LniHqqzcgFfyCf59ZDkWZeDFBy0o08cJUnbxokpIuWT7MQO8Vprurh2DCK44rs7UnxCpXA3fav7OA5yx0AywYMuzPvQJfBNfIwyImgedPyPhb9pV0YwJRH5GVRbPdWqnV5u_pEd0Gs37iWM Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: 279a903930f443a393c257c495ee0cca Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-VolumesGetTestJSON-819141566 Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:47:47.529383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/279a903930f443a393c257c495ee0cca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a903930f443a393c257c495ee0cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/279a903930f443a393c257c495ee0cca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_279a903930f443a393c257c495ee0cca", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-VolumesGetTestJSON-819141566 Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: 279a903930f443a393c257c495ee0cca Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-VolumesGetTestJSON-819141566 Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-VolumesGetTestJSON-819141566-project Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 73c59ce0eb124e49b66ee3b63bafe764 Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-VolumesGetTestJSON-819141566-project Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Volume 7531a049-43bf-4a8d-b68d-ccc685f9f1f5 could not be found. Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': '7531a049-43bf-4a8d-b68d-ccc685f9f1f5'} Jul 18 08:47:47.532107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7531a049-43bf-4a8d-b68d-ccc685f9f1f5 could not be found. (HTTP 404) (Request-ID: req-f98dc950-99fc-42b1-b82d-baab7553bb62) Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:47:47.533500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 08:47:47.535716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7531a049-43bf-4a8d-b68d-ccc685f9f1f5 could not be found. Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 08:47:47.537992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7531a049-43bf-4a8d-b68d-ccc685f9f1f5 could not be found. Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7531a049-43bf-4a8d-b68d-ccc685f9f1f5 could not be found. Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-864010d3-accb-4fee-b30e-96d4dc3c6472 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] Returning 404 to user: Volume 7531a049-43bf-4a8d-b68d-ccc685f9f1f5 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-864010d3-accb-4fee-b30e-96d4dc3c6472 tempest-VolumesGetTestJSON-819141566 tempest-VolumesGetTestJSON-819141566-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5" status: 404 len: 109 microversion: 2.1 time: 0.046715 Jul 18 08:47:47.541014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 91/192] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:47:47 2022] GET /compute/v2.1/os-volumes/7531a049-43bf-4a8d-b68d-ccc685f9f1f5 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 08:47:47.987458 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-cfabe9a6-d4f7-45fe-a5cd-c5b4901cbdae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:47.988142 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-cfabe9a6-d4f7-45fe-a5cd-c5b4901cbdae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:47.994743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cfabe9a6-d4f7-45fe-a5cd-c5b4901cbdae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:47.995198 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cfabe9a6-d4f7-45fe-a5cd-c5b4901cbdae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:47.996066 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cfabe9a6-d4f7-45fe-a5cd-c5b4901cbdae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:47.996507 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cfabe9a6-d4f7-45fe-a5cd-c5b4901cbdae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:48.183612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-cfabe9a6-d4f7-45fe-a5cd-c5b4901cbdae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:48.189278 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-cfabe9a6-d4f7-45fe-a5cd-c5b4901cbdae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.205884 Jul 18 08:47:48.190049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 102/193] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:47 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:49.207006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b43adc58-118c-43c6-b3b4-2beefe1b0f3b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:49.207572 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b43adc58-118c-43c6-b3b4-2beefe1b0f3b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:49.214115 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b43adc58-118c-43c6-b3b4-2beefe1b0f3b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:49.214571 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b43adc58-118c-43c6-b3b4-2beefe1b0f3b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:49.216636 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b43adc58-118c-43c6-b3b4-2beefe1b0f3b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:49.216636 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b43adc58-118c-43c6-b3b4-2beefe1b0f3b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:49.373212 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b43adc58-118c-43c6-b3b4-2beefe1b0f3b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:49.381678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b43adc58-118c-43c6-b3b4-2beefe1b0f3b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.178897 Jul 18 08:47:49.382413 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 92/194] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:49 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:50.401124 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ede0583e-96a8-4d33-bc04-a4c58f6f2725 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:50.402626 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ede0583e-96a8-4d33-bc04-a4c58f6f2725 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:50.413777 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ede0583e-96a8-4d33-bc04-a4c58f6f2725 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:50.414533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ede0583e-96a8-4d33-bc04-a4c58f6f2725 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:50.415840 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ede0583e-96a8-4d33-bc04-a4c58f6f2725 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:50.416508 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ede0583e-96a8-4d33-bc04-a4c58f6f2725 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:50.605829 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ede0583e-96a8-4d33-bc04-a4c58f6f2725 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:50.614618 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ede0583e-96a8-4d33-bc04-a4c58f6f2725 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.218915 Jul 18 08:47:50.615491 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 103/195] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:50 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:51.649413 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-74a25202-c1c7-4c55-b90f-acdac037e988 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:51.650633 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-74a25202-c1c7-4c55-b90f-acdac037e988 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:51.660091 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-74a25202-c1c7-4c55-b90f-acdac037e988 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:51.660532 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-74a25202-c1c7-4c55-b90f-acdac037e988 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:51.663036 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-74a25202-c1c7-4c55-b90f-acdac037e988 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:51.667088 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-74a25202-c1c7-4c55-b90f-acdac037e988 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:51.918610 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-74a25202-c1c7-4c55-b90f-acdac037e988 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:51.932232 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-74a25202-c1c7-4c55-b90f-acdac037e988 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.287247 Jul 18 08:47:51.935161 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 93/196] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:51 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:52.973311 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ba4029cd-4b08-4064-9d09-d66760e5b039 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:52.973907 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ba4029cd-4b08-4064-9d09-d66760e5b039 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:52.981650 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba4029cd-4b08-4064-9d09-d66760e5b039 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:52.982119 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba4029cd-4b08-4064-9d09-d66760e5b039 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:52.983079 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba4029cd-4b08-4064-9d09-d66760e5b039 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:52.983525 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba4029cd-4b08-4064-9d09-d66760e5b039 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:53.005236 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=99 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:53.182307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ba4029cd-4b08-4064-9d09-d66760e5b039 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:53.191089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ba4029cd-4b08-4064-9d09-d66760e5b039 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.229884 Jul 18 08:47:53.199741 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 104/197] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:52 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:54.210477 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5838db26-c980-4bfb-88e6-ec3b51d220ba tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:54.212006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5838db26-c980-4bfb-88e6-ec3b51d220ba tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:54.225144 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5838db26-c980-4bfb-88e6-ec3b51d220ba tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:54.225144 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5838db26-c980-4bfb-88e6-ec3b51d220ba tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:54.225458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5838db26-c980-4bfb-88e6-ec3b51d220ba tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:54.225877 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5838db26-c980-4bfb-88e6-ec3b51d220ba tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:54.411271 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5838db26-c980-4bfb-88e6-ec3b51d220ba tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:54.426026 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5838db26-c980-4bfb-88e6-ec3b51d220ba tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.220309 Jul 18 08:47:54.436931 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 94/198] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:54 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:55.300613 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d2d1a902-6256-4e26-89cb-58824ac08054 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:55.301206 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d2d1a902-6256-4e26-89cb-58824ac08054 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:55.315584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d2d1a902-6256-4e26-89cb-58824ac08054 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:55.315584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d2d1a902-6256-4e26-89cb-58824ac08054 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:55.315584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d2d1a902-6256-4e26-89cb-58824ac08054 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:55.315584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d2d1a902-6256-4e26-89cb-58824ac08054 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:55.357375 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d2d1a902-6256-4e26-89cb-58824ac08054 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/ips" status: 200 len: 146 microversion: 2.1 time: 0.060502 Jul 18 08:47:55.358431 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 105/199] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 08:47:55 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/ips => generated 146 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:47:55.448833 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9689d45d-4803-481d-8503-4c56e0d81d87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:55.452589 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9689d45d-4803-481d-8503-4c56e0d81d87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:55.469892 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9689d45d-4803-481d-8503-4c56e0d81d87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:55.474019 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9689d45d-4803-481d-8503-4c56e0d81d87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:55.479360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9689d45d-4803-481d-8503-4c56e0d81d87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:55.480416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9689d45d-4803-481d-8503-4c56e0d81d87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:55.737298 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9689d45d-4803-481d-8503-4c56e0d81d87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:55.745602 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9689d45d-4803-481d-8503-4c56e0d81d87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.303980 Jul 18 08:47:55.746191 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 95/200] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:55 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:56.765490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-70d29eeb-dda3-4cf3-92e3-34db3c15cb08 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:56.766190 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-70d29eeb-dda3-4cf3-92e3-34db3c15cb08 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:56.773683 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-70d29eeb-dda3-4cf3-92e3-34db3c15cb08 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:56.774240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-70d29eeb-dda3-4cf3-92e3-34db3c15cb08 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:56.775174 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-70d29eeb-dda3-4cf3-92e3-34db3c15cb08 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:56.778216 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-70d29eeb-dda3-4cf3-92e3-34db3c15cb08 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:56.939646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-70d29eeb-dda3-4cf3-92e3-34db3c15cb08 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:56.949016 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-70d29eeb-dda3-4cf3-92e3-34db3c15cb08 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.187655 Jul 18 08:47:56.950091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 106/201] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:56 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:47:57.977037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b5b3f1ce-94e0-4be8-88b0-3bd8371919e1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:57.977838 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b5b3f1ce-94e0-4be8-88b0-3bd8371919e1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:57.985766 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b5b3f1ce-94e0-4be8-88b0-3bd8371919e1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:57.986305 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b5b3f1ce-94e0-4be8-88b0-3bd8371919e1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:57.987117 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b5b3f1ce-94e0-4be8-88b0-3bd8371919e1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:57.987546 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b5b3f1ce-94e0-4be8-88b0-3bd8371919e1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:57.992594 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=98 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:47:58.166982 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b5b3f1ce-94e0-4be8-88b0-3bd8371919e1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:58.175605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b5b3f1ce-94e0-4be8-88b0-3bd8371919e1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.202642 Jul 18 08:47:58.176132 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 96/202] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:57 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:47:59.196743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5c9bd1bc-2be4-4584-ab4b-51d3782e899e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:47:59.196743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5c9bd1bc-2be4-4584-ab4b-51d3782e899e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:47:59.207457 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5c9bd1bc-2be4-4584-ab4b-51d3782e899e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:59.208260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5c9bd1bc-2be4-4584-ab4b-51d3782e899e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:59.209422 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5c9bd1bc-2be4-4584-ab4b-51d3782e899e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:47:59.210659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5c9bd1bc-2be4-4584-ab4b-51d3782e899e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:47:59.406642 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5c9bd1bc-2be4-4584-ab4b-51d3782e899e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:47:59.423586 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5c9bd1bc-2be4-4584-ab4b-51d3782e899e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.225338 Jul 18 08:47:59.423586 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 107/203] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:47:59 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:00.451949 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f9d940cd-f739-458e-be78-91edfb137a39 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:00.454257 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f9d940cd-f739-458e-be78-91edfb137a39 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:00.470273 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f9d940cd-f739-458e-be78-91edfb137a39 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:00.471052 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f9d940cd-f739-458e-be78-91edfb137a39 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:00.472108 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f9d940cd-f739-458e-be78-91edfb137a39 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:00.472810 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f9d940cd-f739-458e-be78-91edfb137a39 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:00.675088 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f9d940cd-f739-458e-be78-91edfb137a39 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:00.686411 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f9d940cd-f739-458e-be78-91edfb137a39 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1520 microversion: 2.1 time: 0.239180 Jul 18 08:48:00.687358 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 97/204] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:00 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:01.385466 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-835798df-f313-4d5d-a9d6-1fa81d7be309 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ee49f62-9eaf-47dd-a582-b4b8daea0984"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:01.386644 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-835798df-f313-4d5d-a9d6-1fa81d7be309 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:01.397361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-835798df-f313-4d5d-a9d6-1fa81d7be309 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:01.397361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-835798df-f313-4d5d-a9d6-1fa81d7be309 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:01.397361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-835798df-f313-4d5d-a9d6-1fa81d7be309 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:01.397361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-835798df-f313-4d5d-a9d6-1fa81d7be309 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:01.706049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d01c9a24-151e-4c25-9e1d-db990ffb6bb8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:01.706049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d01c9a24-151e-4c25-9e1d-db990ffb6bb8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:01.716108 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d01c9a24-151e-4c25-9e1d-db990ffb6bb8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:01.716967 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d01c9a24-151e-4c25-9e1d-db990ffb6bb8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:01.718320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d01c9a24-151e-4c25-9e1d-db990ffb6bb8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:01.719091 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d01c9a24-151e-4c25-9e1d-db990ffb6bb8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:01.881660 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d01c9a24-151e-4c25-9e1d-db990ffb6bb8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:01.890880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d01c9a24-151e-4c25-9e1d-db990ffb6bb8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1500 microversion: 2.1 time: 0.191362 Jul 18 08:48:01.891591 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 98/205] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:01 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1500 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:01.914022 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-06ad206c-47ba-4662-926a-39760d3196fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:01.914777 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-06ad206c-47ba-4662-926a-39760d3196fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:01.922251 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-06ad206c-47ba-4662-926a-39760d3196fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:01.922821 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-06ad206c-47ba-4662-926a-39760d3196fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:01.923761 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-06ad206c-47ba-4662-926a-39760d3196fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:01.924297 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-06ad206c-47ba-4662-926a-39760d3196fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:02.106978 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-06ad206c-47ba-4662-926a-39760d3196fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:02.111892 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-06ad206c-47ba-4662-926a-39760d3196fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1514 microversion: 2.1 time: 0.202012 Jul 18 08:48:02.115716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 99/206] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:01 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:04.899733 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-835798df-f313-4d5d-a9d6-1fa81d7be309 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "POST /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.517914 Jul 18 08:48:04.905823 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 108/207] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:48:01 2022] POST /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/os-volume_attachments => generated 194 bytes in 3520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:48:05.150086 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7e83a526-f443-4069-bf20-8065e50f4384 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:05.151355 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7e83a526-f443-4069-bf20-8065e50f4384 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:05.159300 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7e83a526-f443-4069-bf20-8065e50f4384 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:05.159891 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7e83a526-f443-4069-bf20-8065e50f4384 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:05.161374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7e83a526-f443-4069-bf20-8065e50f4384 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:05.162063 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7e83a526-f443-4069-bf20-8065e50f4384 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:05.193044 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-7e83a526-f443-4069-bf20-8065e50f4384 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lazy-loading 'flavor' on Instance uuid 75cd9ec0-94a9-4043-983e-d876084556ad {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:48:05.659510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7e83a526-f443-4069-bf20-8065e50f4384 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "POST /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad/action" status: 200 len: 32 microversion: 2.1 time: 0.513650 Jul 18 08:48:05.660275 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 100/208] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:48:05 2022] POST /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad/action => generated 32 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 08:48:05.675567 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b21e60b7-9711-4593-b6d7-8fd58967cbdb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:05.676183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b21e60b7-9711-4593-b6d7-8fd58967cbdb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:05.682918 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b21e60b7-9711-4593-b6d7-8fd58967cbdb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:05.683370 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b21e60b7-9711-4593-b6d7-8fd58967cbdb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:05.684183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b21e60b7-9711-4593-b6d7-8fd58967cbdb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:05.684619 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b21e60b7-9711-4593-b6d7-8fd58967cbdb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:05.865038 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b21e60b7-9711-4593-b6d7-8fd58967cbdb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:05.880580 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b21e60b7-9711-4593-b6d7-8fd58967cbdb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.209810 Jul 18 08:48:05.882088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 109/209] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:05 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:06.900877 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-80c8a90d-7f23-4649-ad7d-30c302ccce93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:06.901584 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-80c8a90d-7f23-4649-ad7d-30c302ccce93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:06.909124 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80c8a90d-7f23-4649-ad7d-30c302ccce93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:06.909575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80c8a90d-7f23-4649-ad7d-30c302ccce93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:06.910365 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80c8a90d-7f23-4649-ad7d-30c302ccce93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:06.910815 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80c8a90d-7f23-4649-ad7d-30c302ccce93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:06.968799 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-117c71d1-34ab-4e24-8c2c-f43ea78c531c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:06.968799 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-117c71d1-34ab-4e24-8c2c-f43ea78c531c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:06.989390 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-117c71d1-34ab-4e24-8c2c-f43ea78c531c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:06.989852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-117c71d1-34ab-4e24-8c2c-f43ea78c531c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:06.990651 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-117c71d1-34ab-4e24-8c2c-f43ea78c531c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:06.991095 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-117c71d1-34ab-4e24-8c2c-f43ea78c531c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:07.045906 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-117c71d1-34ab-4e24-8c2c-f43ea78c531c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/ips" status: 200 len: 151 microversion: 2.20 time: 0.084655 Jul 18 08:48:07.049704 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 110/210] 10.222.0.57 () {60 vars in 1288 bytes} [Mon Jul 18 08:48:06 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/ips => generated 151 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 08:48:07.152472 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-80c8a90d-7f23-4649-ad7d-30c302ccce93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:07.165725 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-80c8a90d-7f23-4649-ad7d-30c302ccce93 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.269170 Jul 18 08:48:07.166568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 101/211] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:06 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:07.775663 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d00a91d1-8159-425d-8c5e-9af5e997f97a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:07.776193 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d00a91d1-8159-425d-8c5e-9af5e997f97a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:07.787019 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d00a91d1-8159-425d-8c5e-9af5e997f97a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:07.788077 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d00a91d1-8159-425d-8c5e-9af5e997f97a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:07.789314 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d00a91d1-8159-425d-8c5e-9af5e997f97a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:07.790173 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d00a91d1-8159-425d-8c5e-9af5e997f97a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:07.825465 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d00a91d1-8159-425d-8c5e-9af5e997f97a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/ips" status: 200 len: 148 microversion: 2.1 time: 0.054091 Jul 18 08:48:07.826355 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 111/212] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 08:48:07 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/ips => generated 148 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:48:08.186020 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0e4b4ff2-483a-45a1-99db-9440896489b5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:08.187308 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0e4b4ff2-483a-45a1-99db-9440896489b5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:08.197359 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e4b4ff2-483a-45a1-99db-9440896489b5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:08.197359 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e4b4ff2-483a-45a1-99db-9440896489b5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:08.198618 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e4b4ff2-483a-45a1-99db-9440896489b5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:08.199606 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e4b4ff2-483a-45a1-99db-9440896489b5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:08.490059 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0e4b4ff2-483a-45a1-99db-9440896489b5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:08.516231 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0e4b4ff2-483a-45a1-99db-9440896489b5 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.328331 Jul 18 08:48:08.517842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 102/213] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:08 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:09.534413 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-42067036-32ff-43a3-bdf8-11f0e71f6a2e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:09.536262 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-42067036-32ff-43a3-bdf8-11f0e71f6a2e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:09.544447 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-42067036-32ff-43a3-bdf8-11f0e71f6a2e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:09.544898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-42067036-32ff-43a3-bdf8-11f0e71f6a2e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:09.545860 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-42067036-32ff-43a3-bdf8-11f0e71f6a2e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:09.546492 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-42067036-32ff-43a3-bdf8-11f0e71f6a2e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:09.743280 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-42067036-32ff-43a3-bdf8-11f0e71f6a2e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:09.755404 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-42067036-32ff-43a3-bdf8-11f0e71f6a2e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.225058 Jul 18 08:48:09.756486 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 112/214] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:09 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:09.991247 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5f1fb3f7-8075-4942-8c82-94d9c688807f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6a25938-7d9d-4834-9916-9db898082e67"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:09.992842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5f1fb3f7-8075-4942-8c82-94d9c688807f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:10.001254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5f1fb3f7-8075-4942-8c82-94d9c688807f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:10.001823 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5f1fb3f7-8075-4942-8c82-94d9c688807f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:10.003019 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5f1fb3f7-8075-4942-8c82-94d9c688807f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:10.003571 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5f1fb3f7-8075-4942-8c82-94d9c688807f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:10.775608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2ed5ab4e-05b8-47da-8893-7436c41c9675 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:10.776904 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-2ed5ab4e-05b8-47da-8893-7436c41c9675 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:10.786577 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2ed5ab4e-05b8-47da-8893-7436c41c9675 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:10.787368 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2ed5ab4e-05b8-47da-8893-7436c41c9675 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:10.791176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2ed5ab4e-05b8-47da-8893-7436c41c9675 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:10.791176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2ed5ab4e-05b8-47da-8893-7436c41c9675 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:11.012079 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2ed5ab4e-05b8-47da-8893-7436c41c9675 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:11.020695 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2ed5ab4e-05b8-47da-8893-7436c41c9675 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.249582 Jul 18 08:48:11.021306 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 113/215] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:10 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:11.354312 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-65560ea4-f7a8-41a1-8b20-1bdc2ef9b129 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:11.355192 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-65560ea4-f7a8-41a1-8b20-1bdc2ef9b129 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:11.366602 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-65560ea4-f7a8-41a1-8b20-1bdc2ef9b129 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:11.377297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-65560ea4-f7a8-41a1-8b20-1bdc2ef9b129 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:11.377297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-65560ea4-f7a8-41a1-8b20-1bdc2ef9b129 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:11.377297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-65560ea4-f7a8-41a1-8b20-1bdc2ef9b129 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:11.411382 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-65560ea4-f7a8-41a1-8b20-1bdc2ef9b129 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lazy-loading 'flavor' on Instance uuid f3d6245b-0c6d-4a19-85c6-841d85912f2e {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:48:11.438617 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5f1fb3f7-8075-4942-8c82-94d9c688807f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.451589 Jul 18 08:48:11.442132 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 103/216] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:48:09 2022] POST /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments => generated 194 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:48:12.039807 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3b7bbccc-696c-4c65-89fb-f06c4a313ece tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:12.040368 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3b7bbccc-696c-4c65-89fb-f06c4a313ece tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:12.049509 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3b7bbccc-696c-4c65-89fb-f06c4a313ece tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:12.055356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3b7bbccc-696c-4c65-89fb-f06c4a313ece tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:12.055356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3b7bbccc-696c-4c65-89fb-f06c4a313ece tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:12.055356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3b7bbccc-696c-4c65-89fb-f06c4a313ece tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:12.240659 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3b7bbccc-696c-4c65-89fb-f06c4a313ece tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:12.267493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3b7bbccc-696c-4c65-89fb-f06c4a313ece tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.227430 Jul 18 08:48:12.267493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 104/217] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:12 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:12.275859 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-65560ea4-f7a8-41a1-8b20-1bdc2ef9b129 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "POST /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/action" status: 202 len: 0 microversion: 2.20 time: 0.926437 Jul 18 08:48:12.277187 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 114/218] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 08:48:11 2022] POST /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/action => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 08:48:12.289614 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f634d66b-9e4d-4d59-9d9e-c2d2b1d4711e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:12.290644 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f634d66b-9e4d-4d59-9d9e-c2d2b1d4711e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:12.301089 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f634d66b-9e4d-4d59-9d9e-c2d2b1d4711e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:12.301868 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f634d66b-9e4d-4d59-9d9e-c2d2b1d4711e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:12.303288 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f634d66b-9e4d-4d59-9d9e-c2d2b1d4711e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:12.304129 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f634d66b-9e4d-4d59-9d9e-c2d2b1d4711e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:12.487714 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f634d66b-9e4d-4d59-9d9e-c2d2b1d4711e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:12.499872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f634d66b-9e4d-4d59-9d9e-c2d2b1d4711e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:12.501864 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f634d66b-9e4d-4d59-9d9e-c2d2b1d4711e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:12.503317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f634d66b-9e4d-4d59-9d9e-c2d2b1d4711e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.221099 Jul 18 08:48:12.507729 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 105/219] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:12 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:13.283915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b1fd35c1-4e11-4c6c-b556-73699e1305eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:13.284603 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b1fd35c1-4e11-4c6c-b556-73699e1305eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:13.286622 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=32 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:13.292808 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b1fd35c1-4e11-4c6c-b556-73699e1305eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:13.293873 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b1fd35c1-4e11-4c6c-b556-73699e1305eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:13.294946 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b1fd35c1-4e11-4c6c-b556-73699e1305eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:13.295136 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b1fd35c1-4e11-4c6c-b556-73699e1305eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:13.484316 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b1fd35c1-4e11-4c6c-b556-73699e1305eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:13.492701 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b1fd35c1-4e11-4c6c-b556-73699e1305eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.213598 Jul 18 08:48:13.493329 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 115/220] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:13 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:13.522733 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-56fe2dac-1d2c-4962-9543-b9d607bc658a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:13.523369 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-56fe2dac-1d2c-4962-9543-b9d607bc658a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:13.525889 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=34 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:13.532082 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-56fe2dac-1d2c-4962-9543-b9d607bc658a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:13.532568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-56fe2dac-1d2c-4962-9543-b9d607bc658a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:13.533401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-56fe2dac-1d2c-4962-9543-b9d607bc658a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:13.533834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-56fe2dac-1d2c-4962-9543-b9d607bc658a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:13.687275 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-56fe2dac-1d2c-4962-9543-b9d607bc658a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:13.703953 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-56fe2dac-1d2c-4962-9543-b9d607bc658a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:13.705786 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-56fe2dac-1d2c-4962-9543-b9d607bc658a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:13.707403 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-56fe2dac-1d2c-4962-9543-b9d607bc658a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.188540 Jul 18 08:48:13.722955 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 106/221] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:13 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:14.510241 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e150ef4c-518d-43d4-a8ee-1e3f1cf22761 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:14.510897 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e150ef4c-518d-43d4-a8ee-1e3f1cf22761 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:14.518380 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e150ef4c-518d-43d4-a8ee-1e3f1cf22761 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:14.518836 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e150ef4c-518d-43d4-a8ee-1e3f1cf22761 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:14.519730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e150ef4c-518d-43d4-a8ee-1e3f1cf22761 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:14.520333 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e150ef4c-518d-43d4-a8ee-1e3f1cf22761 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:14.727768 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e150ef4c-518d-43d4-a8ee-1e3f1cf22761 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:14.731912 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ccda7b24-e1ac-4b93-85b2-7da1a021a1cd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:14.733378 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ccda7b24-e1ac-4b93-85b2-7da1a021a1cd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:14.740395 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ccda7b24-e1ac-4b93-85b2-7da1a021a1cd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:14.740839 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ccda7b24-e1ac-4b93-85b2-7da1a021a1cd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:14.741833 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ccda7b24-e1ac-4b93-85b2-7da1a021a1cd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:14.742278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ccda7b24-e1ac-4b93-85b2-7da1a021a1cd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:14.771720 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e150ef4c-518d-43d4-a8ee-1e3f1cf22761 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.251374 Jul 18 08:48:14.771720 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 116/222] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:14 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:15.294621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ccda7b24-e1ac-4b93-85b2-7da1a021a1cd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:15.300506 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ccda7b24-e1ac-4b93-85b2-7da1a021a1cd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:15.302580 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ccda7b24-e1ac-4b93-85b2-7da1a021a1cd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:15.304767 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ccda7b24-e1ac-4b93-85b2-7da1a021a1cd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.576909 Jul 18 08:48:15.323166 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 107/223] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:14 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:15.785993 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9330a263-8dae-4a9c-aade-6486032c9109 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:15.787266 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9330a263-8dae-4a9c-aade-6486032c9109 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:15.798126 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9330a263-8dae-4a9c-aade-6486032c9109 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:15.799123 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9330a263-8dae-4a9c-aade-6486032c9109 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:15.799994 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9330a263-8dae-4a9c-aade-6486032c9109 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:15.800657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9330a263-8dae-4a9c-aade-6486032c9109 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:15.975307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9330a263-8dae-4a9c-aade-6486032c9109 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:15.984464 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9330a263-8dae-4a9c-aade-6486032c9109 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.202316 Jul 18 08:48:15.985055 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 117/224] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:15 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:16.362523 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-553584ac-719d-42c7-9719-d9b30aefdbff tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:16.363662 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-553584ac-719d-42c7-9719-d9b30aefdbff tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:16.376827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-553584ac-719d-42c7-9719-d9b30aefdbff tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:16.377761 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-553584ac-719d-42c7-9719-d9b30aefdbff tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:16.379346 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-553584ac-719d-42c7-9719-d9b30aefdbff tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:16.380420 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-553584ac-719d-42c7-9719-d9b30aefdbff tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:16.658338 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-553584ac-719d-42c7-9719-d9b30aefdbff tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:16.671977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-553584ac-719d-42c7-9719-d9b30aefdbff tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:16.673532 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-553584ac-719d-42c7-9719-d9b30aefdbff tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:16.674875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-553584ac-719d-42c7-9719-d9b30aefdbff tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.321783 Jul 18 08:48:16.675952 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 108/225] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:16 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:16.889413 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f30eb914-819f-4de2-8391-5ff19b714da0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:16.897049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f30eb914-819f-4de2-8391-5ff19b714da0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:16.897506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f30eb914-819f-4de2-8391-5ff19b714da0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:17.008308 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a2773251-303c-4e0a-b1b4-ca75a5dd3dd9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:17.009266 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a2773251-303c-4e0a-b1b4-ca75a5dd3dd9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:17.017657 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a2773251-303c-4e0a-b1b4-ca75a5dd3dd9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:17.018375 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a2773251-303c-4e0a-b1b4-ca75a5dd3dd9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:17.019629 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a2773251-303c-4e0a-b1b4-ca75a5dd3dd9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:17.020373 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a2773251-303c-4e0a-b1b4-ca75a5dd3dd9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:17.055493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:17.152537 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:17.165960 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f30eb914-819f-4de2-8391-5ff19b714da0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Going to try to stop instance {{(pid=124894) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 08:48:17.280367 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a2773251-303c-4e0a-b1b4-ca75a5dd3dd9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:17.291134 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a2773251-303c-4e0a-b1b4-ca75a5dd3dd9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.289298 Jul 18 08:48:17.292994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 109/226] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:16 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:17.505256 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f30eb914-819f-4de2-8391-5ff19b714da0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "POST /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/action" status: 202 len: 0 microversion: 2.1 time: 0.620844 Jul 18 08:48:17.505869 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 118/227] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:48:16 2022] POST /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 08:48:17.515412 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-dd1ebf2c-8ef7-4182-a88f-9ce131d0a8eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:17.516074 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-dd1ebf2c-8ef7-4182-a88f-9ce131d0a8eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:17.523998 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd1ebf2c-8ef7-4182-a88f-9ce131d0a8eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:17.524713 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd1ebf2c-8ef7-4182-a88f-9ce131d0a8eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:17.525836 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd1ebf2c-8ef7-4182-a88f-9ce131d0a8eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:17.526302 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd1ebf2c-8ef7-4182-a88f-9ce131d0a8eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:17.702069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a30a49b6-c551-4955-80e3-f1330697b0bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:17.702780 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a30a49b6-c551-4955-80e3-f1330697b0bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:17.711887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a30a49b6-c551-4955-80e3-f1330697b0bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:17.712802 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a30a49b6-c551-4955-80e3-f1330697b0bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:17.713871 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a30a49b6-c551-4955-80e3-f1330697b0bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:17.714533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a30a49b6-c551-4955-80e3-f1330697b0bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:17.751713 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-dd1ebf2c-8ef7-4182-a88f-9ce131d0a8eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:17.764873 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-dd1ebf2c-8ef7-4182-a88f-9ce131d0a8eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.251925 Jul 18 08:48:17.770464 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 110/228] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:17 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:17.924783 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a30a49b6-c551-4955-80e3-f1330697b0bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:17.933588 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a30a49b6-c551-4955-80e3-f1330697b0bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:17.935126 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a30a49b6-c551-4955-80e3-f1330697b0bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:17.936364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a30a49b6-c551-4955-80e3-f1330697b0bc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.239733 Jul 18 08:48:17.936931 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 119/229] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:17 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:18.322168 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6c5ad854-af70-47be-8a17-fe1f47cae163 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:18.322863 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-6c5ad854-af70-47be-8a17-fe1f47cae163 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:18.330237 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6c5ad854-af70-47be-8a17-fe1f47cae163 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:18.330744 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6c5ad854-af70-47be-8a17-fe1f47cae163 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:18.331536 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6c5ad854-af70-47be-8a17-fe1f47cae163 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:18.332013 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6c5ad854-af70-47be-8a17-fe1f47cae163 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:18.524095 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6c5ad854-af70-47be-8a17-fe1f47cae163 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:18.534094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-6c5ad854-af70-47be-8a17-fe1f47cae163 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.215711 Jul 18 08:48:18.534094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 111/230] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:18 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:18.797669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-23ad2ab8-efe0-4764-83cb-58bd7d1c4085 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:18.798902 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-23ad2ab8-efe0-4764-83cb-58bd7d1c4085 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:18.810890 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-23ad2ab8-efe0-4764-83cb-58bd7d1c4085 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:18.811701 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-23ad2ab8-efe0-4764-83cb-58bd7d1c4085 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:18.812733 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-23ad2ab8-efe0-4764-83cb-58bd7d1c4085 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:18.813338 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-23ad2ab8-efe0-4764-83cb-58bd7d1c4085 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:18.958138 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-67cfd46b-3dda-49de-ae60-cf00cc56e7dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:18.958647 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-67cfd46b-3dda-49de-ae60-cf00cc56e7dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:18.965923 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-67cfd46b-3dda-49de-ae60-cf00cc56e7dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:18.966518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-67cfd46b-3dda-49de-ae60-cf00cc56e7dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:18.967328 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-67cfd46b-3dda-49de-ae60-cf00cc56e7dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:18.967813 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-67cfd46b-3dda-49de-ae60-cf00cc56e7dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:19.019039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-23ad2ab8-efe0-4764-83cb-58bd7d1c4085 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:19.031396 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-23ad2ab8-efe0-4764-83cb-58bd7d1c4085 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.239751 Jul 18 08:48:19.032507 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 120/231] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:18 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:19.129148 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-67cfd46b-3dda-49de-ae60-cf00cc56e7dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:19.138432 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-67cfd46b-3dda-49de-ae60-cf00cc56e7dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:19.140035 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-67cfd46b-3dda-49de-ae60-cf00cc56e7dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:19.141256 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-67cfd46b-3dda-49de-ae60-cf00cc56e7dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.187511 Jul 18 08:48:19.141832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 112/232] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:18 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:19.552343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8e6d31bd-175a-463d-9551-6e2b554735e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:19.553538 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8e6d31bd-175a-463d-9551-6e2b554735e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:19.567980 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8e6d31bd-175a-463d-9551-6e2b554735e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:19.567980 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8e6d31bd-175a-463d-9551-6e2b554735e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:19.567980 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8e6d31bd-175a-463d-9551-6e2b554735e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:19.567980 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8e6d31bd-175a-463d-9551-6e2b554735e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:19.758414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8e6d31bd-175a-463d-9551-6e2b554735e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:19.767469 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8e6d31bd-175a-463d-9551-6e2b554735e9 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.220570 Jul 18 08:48:19.768234 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 121/233] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:19 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:20.055911 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-20504f73-316c-4b19-b0d4-d46ca1771646 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:20.056571 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-20504f73-316c-4b19-b0d4-d46ca1771646 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:20.064758 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-20504f73-316c-4b19-b0d4-d46ca1771646 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:20.065223 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-20504f73-316c-4b19-b0d4-d46ca1771646 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:20.066040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-20504f73-316c-4b19-b0d4-d46ca1771646 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:20.066487 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-20504f73-316c-4b19-b0d4-d46ca1771646 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:20.173209 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e09abddb-91fb-420a-a06d-077d899f895d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:20.174362 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e09abddb-91fb-420a-a06d-077d899f895d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:20.186796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e09abddb-91fb-420a-a06d-077d899f895d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:20.187575 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e09abddb-91fb-420a-a06d-077d899f895d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:20.189066 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e09abddb-91fb-420a-a06d-077d899f895d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:20.189881 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e09abddb-91fb-420a-a06d-077d899f895d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:20.238538 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-20504f73-316c-4b19-b0d4-d46ca1771646 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:20.248185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-20504f73-316c-4b19-b0d4-d46ca1771646 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.196318 Jul 18 08:48:20.249087 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 113/234] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:20 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:20.363895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e09abddb-91fb-420a-a06d-077d899f895d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:20.380470 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e09abddb-91fb-420a-a06d-077d899f895d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:20.383794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e09abddb-91fb-420a-a06d-077d899f895d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:20.386154 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e09abddb-91fb-420a-a06d-077d899f895d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.228261 Jul 18 08:48:20.387841 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 122/235] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:20 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:20.794252 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3c9fb9ff-d57a-4ecb-8014-30e718c6c452 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:20.794991 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3c9fb9ff-d57a-4ecb-8014-30e718c6c452 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:20.801903 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3c9fb9ff-d57a-4ecb-8014-30e718c6c452 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:20.802356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3c9fb9ff-d57a-4ecb-8014-30e718c6c452 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:20.803149 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3c9fb9ff-d57a-4ecb-8014-30e718c6c452 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:20.803588 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3c9fb9ff-d57a-4ecb-8014-30e718c6c452 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:21.038159 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3c9fb9ff-d57a-4ecb-8014-30e718c6c452 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:21.052178 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3c9fb9ff-d57a-4ecb-8014-30e718c6c452 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.262021 Jul 18 08:48:21.053573 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 114/236] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:20 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:21.267937 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e4670872-c9d6-4987-a99a-a7bb61583858 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:21.268711 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e4670872-c9d6-4987-a99a-a7bb61583858 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:21.276250 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4670872-c9d6-4987-a99a-a7bb61583858 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:21.276715 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4670872-c9d6-4987-a99a-a7bb61583858 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:21.278042 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4670872-c9d6-4987-a99a-a7bb61583858 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:21.278491 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4670872-c9d6-4987-a99a-a7bb61583858 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:21.415391 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5c51cc58-b22c-4336-aacd-64ccbe6c9c22 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:21.416604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5c51cc58-b22c-4336-aacd-64ccbe6c9c22 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:21.429642 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5c51cc58-b22c-4336-aacd-64ccbe6c9c22 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:21.430728 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5c51cc58-b22c-4336-aacd-64ccbe6c9c22 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:21.432261 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5c51cc58-b22c-4336-aacd-64ccbe6c9c22 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:21.433069 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5c51cc58-b22c-4336-aacd-64ccbe6c9c22 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:21.469347 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e4670872-c9d6-4987-a99a-a7bb61583858 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:21.477982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e4670872-c9d6-4987-a99a-a7bb61583858 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.214159 Jul 18 08:48:21.484730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 123/237] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:21 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:21.634285 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5c51cc58-b22c-4336-aacd-64ccbe6c9c22 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:21.643879 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5c51cc58-b22c-4336-aacd-64ccbe6c9c22 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:21.645414 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5c51cc58-b22c-4336-aacd-64ccbe6c9c22 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:21.646614 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5c51cc58-b22c-4336-aacd-64ccbe6c9c22 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.239886 Jul 18 08:48:21.647376 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 115/238] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:21 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:22.072615 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e6fb348c-1375-4355-9535-3af34bb6db61 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:22.076608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e6fb348c-1375-4355-9535-3af34bb6db61 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:22.085995 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e6fb348c-1375-4355-9535-3af34bb6db61 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:22.086818 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e6fb348c-1375-4355-9535-3af34bb6db61 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:22.089047 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e6fb348c-1375-4355-9535-3af34bb6db61 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:22.089625 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e6fb348c-1375-4355-9535-3af34bb6db61 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:22.259792 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e6fb348c-1375-4355-9535-3af34bb6db61 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:22.268736 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e6fb348c-1375-4355-9535-3af34bb6db61 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.201431 Jul 18 08:48:22.269422 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 124/239] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:22 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:22.511296 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-66632b61-853f-4239-bd81-4d9e8c5d6548 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:22.511953 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-66632b61-853f-4239-bd81-4d9e8c5d6548 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:22.519573 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-66632b61-853f-4239-bd81-4d9e8c5d6548 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:22.520102 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-66632b61-853f-4239-bd81-4d9e8c5d6548 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:22.520973 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-66632b61-853f-4239-bd81-4d9e8c5d6548 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:22.521415 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-66632b61-853f-4239-bd81-4d9e8c5d6548 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:22.681855 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b960574f-bf78-455a-94ae-e5ac8a150ad1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:22.682918 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b960574f-bf78-455a-94ae-e5ac8a150ad1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:22.713841 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b960574f-bf78-455a-94ae-e5ac8a150ad1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:22.714609 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b960574f-bf78-455a-94ae-e5ac8a150ad1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:22.716682 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b960574f-bf78-455a-94ae-e5ac8a150ad1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:22.717420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b960574f-bf78-455a-94ae-e5ac8a150ad1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:22.754252 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-66632b61-853f-4239-bd81-4d9e8c5d6548 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:22.773422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-66632b61-853f-4239-bd81-4d9e8c5d6548 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.265696 Jul 18 08:48:22.790509 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 116/240] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:22 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:22.977036 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b960574f-bf78-455a-94ae-e5ac8a150ad1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:22.994855 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b960574f-bf78-455a-94ae-e5ac8a150ad1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:22.998921 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b960574f-bf78-455a-94ae-e5ac8a150ad1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:23.001263 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b960574f-bf78-455a-94ae-e5ac8a150ad1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.328580 Jul 18 08:48:23.002306 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 125/241] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:22 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:23.156297 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a7303ed4-6abb-4d96-b362-6d70482262c5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: .version_select at 0x7fafb7c91700>, body: {"keypair": {"name": "tempest-keypair-374408592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuLxiqZ8qBlhbDL6lQDjKdyJtmEXuGZQnYou6liIlDSNUfxEzRuK1jhicX/M6KlX0QVemn7hk6zFsymJqV4WgFmOHwbzuDIQ0eBQxBsY6k3YzKHqbFjAuhAjBAKDKuRyg=="}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:23.188512 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-a7303ed4-6abb-4d96-b362-6d70482262c5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:48:23.193485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-a7303ed4-6abb-4d96-b362-6d70482262c5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for user 4e6b788e0819483580c09902a341ea6d and project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:48:23.296495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-cef9a633-34a8-4d29-ae27-2c4a2c56df06 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:23.297386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-cef9a633-34a8-4d29-ae27-2c4a2c56df06 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:23.305603 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cef9a633-34a8-4d29-ae27-2c4a2c56df06 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:23.306355 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cef9a633-34a8-4d29-ae27-2c4a2c56df06 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:23.307481 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cef9a633-34a8-4d29-ae27-2c4a2c56df06 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:23.308100 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cef9a633-34a8-4d29-ae27-2c4a2c56df06 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:23.351071 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a7303ed4-6abb-4d96-b362-6d70482262c5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.199949 Jul 18 08:48:23.352304 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 117/242] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 08:48:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:48:23.536248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-cef9a633-34a8-4d29-ae27-2c4a2c56df06 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:23.547142 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-cef9a633-34a8-4d29-ae27-2c4a2c56df06 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.256475 Jul 18 08:48:23.548166 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 126/243] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:23 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:23.802681 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9693e7fa-fb32-40d7-8f60-40e8d19bdc31 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:23.802681 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9693e7fa-fb32-40d7-8f60-40e8d19bdc31 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:23.806819 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9693e7fa-fb32-40d7-8f60-40e8d19bdc31 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:23.807275 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9693e7fa-fb32-40d7-8f60-40e8d19bdc31 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:23.808108 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9693e7fa-fb32-40d7-8f60-40e8d19bdc31 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:23.808546 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9693e7fa-fb32-40d7-8f60-40e8d19bdc31 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:24.023635 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-fb3389d6-8f0e-45b7-9b00-102376843c1d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:24.025070 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-fb3389d6-8f0e-45b7-9b00-102376843c1d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:24.036817 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9693e7fa-fb32-40d7-8f60-40e8d19bdc31 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:24.052601 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9693e7fa-fb32-40d7-8f60-40e8d19bdc31 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.257305 Jul 18 08:48:24.054545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 118/244] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:23 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:24.056321 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fb3389d6-8f0e-45b7-9b00-102376843c1d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:24.057307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fb3389d6-8f0e-45b7-9b00-102376843c1d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:24.059471 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fb3389d6-8f0e-45b7-9b00-102376843c1d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:24.061078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fb3389d6-8f0e-45b7-9b00-102376843c1d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:24.271497 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-fb3389d6-8f0e-45b7-9b00-102376843c1d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:24.288279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-fb3389d6-8f0e-45b7-9b00-102376843c1d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:24.291795 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-fb3389d6-8f0e-45b7-9b00-102376843c1d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:24.294723 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-fb3389d6-8f0e-45b7-9b00-102376843c1d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.276771 Jul 18 08:48:24.295726 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 127/245] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:24 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:24.568120 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f92ce3a4-0e10-4ee3-b950-f08f288d7f72 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:24.568933 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f92ce3a4-0e10-4ee3-b950-f08f288d7f72 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:24.579164 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f92ce3a4-0e10-4ee3-b950-f08f288d7f72 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:24.579972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f92ce3a4-0e10-4ee3-b950-f08f288d7f72 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:24.581360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f92ce3a4-0e10-4ee3-b950-f08f288d7f72 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:24.582072 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f92ce3a4-0e10-4ee3-b950-f08f288d7f72 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:24.880257 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f92ce3a4-0e10-4ee3-b950-f08f288d7f72 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:24.903343 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f92ce3a4-0e10-4ee3-b950-f08f288d7f72 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.331865 Jul 18 08:48:24.903832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 119/246] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:24 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:25.079559 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d7df0d67-a8e4-4bd3-8b30-6f30f73eaa75 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:25.081056 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d7df0d67-a8e4-4bd3-8b30-6f30f73eaa75 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:25.088626 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d7df0d67-a8e4-4bd3-8b30-6f30f73eaa75 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:25.089211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d7df0d67-a8e4-4bd3-8b30-6f30f73eaa75 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:25.096646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d7df0d67-a8e4-4bd3-8b30-6f30f73eaa75 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:25.096646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d7df0d67-a8e4-4bd3-8b30-6f30f73eaa75 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:25.277234 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d7df0d67-a8e4-4bd3-8b30-6f30f73eaa75 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:25.289077 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d7df0d67-a8e4-4bd3-8b30-6f30f73eaa75 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.214019 Jul 18 08:48:25.290107 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 128/247] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:25 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:25.334490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-805a1db3-79ce-4d65-9abb-bf3b5e6c71ec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:25.335240 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-805a1db3-79ce-4d65-9abb-bf3b5e6c71ec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:25.343079 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-805a1db3-79ce-4d65-9abb-bf3b5e6c71ec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:25.343635 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-805a1db3-79ce-4d65-9abb-bf3b5e6c71ec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:25.344548 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-805a1db3-79ce-4d65-9abb-bf3b5e6c71ec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:25.345121 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-805a1db3-79ce-4d65-9abb-bf3b5e6c71ec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:25.587709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-805a1db3-79ce-4d65-9abb-bf3b5e6c71ec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:25.601695 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-805a1db3-79ce-4d65-9abb-bf3b5e6c71ec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:25.604778 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-805a1db3-79ce-4d65-9abb-bf3b5e6c71ec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:25.607048 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-805a1db3-79ce-4d65-9abb-bf3b5e6c71ec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.286126 Jul 18 08:48:25.608170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 120/248] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:25 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:25.924769 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e2502c33-1113-436a-a144-d7040d80c94a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:25.925398 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e2502c33-1113-436a-a144-d7040d80c94a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:25.936644 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e2502c33-1113-436a-a144-d7040d80c94a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:25.937854 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e2502c33-1113-436a-a144-d7040d80c94a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:25.939304 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e2502c33-1113-436a-a144-d7040d80c94a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:25.939994 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e2502c33-1113-436a-a144-d7040d80c94a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:26.163539 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e2502c33-1113-436a-a144-d7040d80c94a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:26.174491 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e2502c33-1113-436a-a144-d7040d80c94a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.253623 Jul 18 08:48:26.175440 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 129/249] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:25 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:26.310784 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0fbcd017-d1d4-4a99-bfc6-0e8adb599543 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:26.311458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0fbcd017-d1d4-4a99-bfc6-0e8adb599543 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:26.319485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0fbcd017-d1d4-4a99-bfc6-0e8adb599543 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:26.319880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0fbcd017-d1d4-4a99-bfc6-0e8adb599543 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:26.320665 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0fbcd017-d1d4-4a99-bfc6-0e8adb599543 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:26.321106 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0fbcd017-d1d4-4a99-bfc6-0e8adb599543 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:26.572103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0fbcd017-d1d4-4a99-bfc6-0e8adb599543 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:26.581384 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0fbcd017-d1d4-4a99-bfc6-0e8adb599543 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.275249 Jul 18 08:48:26.581977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 121/250] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:26 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:26.631261 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6b13e1b4-75ba-4b82-9444-5efffd152917 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:26.632798 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6b13e1b4-75ba-4b82-9444-5efffd152917 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:26.641399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6b13e1b4-75ba-4b82-9444-5efffd152917 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:26.641857 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6b13e1b4-75ba-4b82-9444-5efffd152917 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:26.642897 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6b13e1b4-75ba-4b82-9444-5efffd152917 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:26.643451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6b13e1b4-75ba-4b82-9444-5efffd152917 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:26.772051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-467177327", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91d2b33d-7b11-4b88-9cd3-44537bfe048d"}], "security_groups": [{"name": "tempest-securitygroup--1561596411"}], "key_name": "tempest-keypair-374408592", "user_data": "}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:26.817881 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6b13e1b4-75ba-4b82-9444-5efffd152917 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:26.836305 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6b13e1b4-75ba-4b82-9444-5efffd152917 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:26.841231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6b13e1b4-75ba-4b82-9444-5efffd152917 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:26.844130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6b13e1b4-75ba-4b82-9444-5efffd152917 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.220024 Jul 18 08:48:26.846450 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 130/251] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:26 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:27.192986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5ab2f621-d82d-407c-b026-6eae736e3f92 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:27.193643 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5ab2f621-d82d-407c-b026-6eae736e3f92 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:27.202429 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ab2f621-d82d-407c-b026-6eae736e3f92 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:27.203880 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ab2f621-d82d-407c-b026-6eae736e3f92 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:27.204723 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ab2f621-d82d-407c-b026-6eae736e3f92 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:27.205176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ab2f621-d82d-407c-b026-6eae736e3f92 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:27.372567 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5ab2f621-d82d-407c-b026-6eae736e3f92 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:27.381192 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5ab2f621-d82d-407c-b026-6eae736e3f92 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.192528 Jul 18 08:48:27.381786 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 131/252] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:27 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:27.598691 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-10087e4c-3865-4daa-9423-68d5d944d78f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:27.599306 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-10087e4c-3865-4daa-9423-68d5d944d78f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:27.605980 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-10087e4c-3865-4daa-9423-68d5d944d78f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:27.606579 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-10087e4c-3865-4daa-9423-68d5d944d78f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:27.607397 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-10087e4c-3865-4daa-9423-68d5d944d78f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:27.607868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-10087e4c-3865-4daa-9423-68d5d944d78f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:27.785176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-10087e4c-3865-4daa-9423-68d5d944d78f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:27.794281 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-10087e4c-3865-4daa-9423-68d5d944d78f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.199556 Jul 18 08:48:27.795067 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 132/253] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:27 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:27.864422 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2cb3d250-3ea6-4df0-b2f0-8bfa22f8ddfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:27.865130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-2cb3d250-3ea6-4df0-b2f0-8bfa22f8ddfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:27.874103 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2cb3d250-3ea6-4df0-b2f0-8bfa22f8ddfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:27.874552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2cb3d250-3ea6-4df0-b2f0-8bfa22f8ddfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:27.875361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2cb3d250-3ea6-4df0-b2f0-8bfa22f8ddfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:27.875829 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2cb3d250-3ea6-4df0-b2f0-8bfa22f8ddfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:28.079193 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2cb3d250-3ea6-4df0-b2f0-8bfa22f8ddfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:28.088653 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2cb3d250-3ea6-4df0-b2f0-8bfa22f8ddfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:28.091049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2cb3d250-3ea6-4df0-b2f0-8bfa22f8ddfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:28.092462 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2cb3d250-3ea6-4df0-b2f0-8bfa22f8ddfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.232181 Jul 18 08:48:28.093100 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 133/254] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:27 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:28.400969 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9d5c5459-ae7a-422e-b056-d777baba4d0e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:28.402032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9d5c5459-ae7a-422e-b056-d777baba4d0e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:28.415446 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9d5c5459-ae7a-422e-b056-d777baba4d0e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:28.416372 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9d5c5459-ae7a-422e-b056-d777baba4d0e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:28.418018 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9d5c5459-ae7a-422e-b056-d777baba4d0e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:28.418873 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9d5c5459-ae7a-422e-b056-d777baba4d0e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:28.424727 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:28.596562 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9d5c5459-ae7a-422e-b056-d777baba4d0e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:28.604799 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9d5c5459-ae7a-422e-b056-d777baba4d0e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.208779 Jul 18 08:48:28.605536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 134/255] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:28 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:28.820111 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-886b6303-18a1-47a0-bcb1-f31432c2f572 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:28.820737 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-886b6303-18a1-47a0-bcb1-f31432c2f572 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:28.827785 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-886b6303-18a1-47a0-bcb1-f31432c2f572 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:28.828492 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-886b6303-18a1-47a0-bcb1-f31432c2f572 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:28.829268 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-886b6303-18a1-47a0-bcb1-f31432c2f572 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:28.829696 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-886b6303-18a1-47a0-bcb1-f31432c2f572 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:28.989265 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-886b6303-18a1-47a0-bcb1-f31432c2f572 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:28.998642 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-886b6303-18a1-47a0-bcb1-f31432c2f572 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.182612 Jul 18 08:48:28.999235 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 135/256] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:28 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:29.113309 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7876541a-b176-4d12-b0ed-75424ad96085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:29.114136 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7876541a-b176-4d12-b0ed-75424ad96085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:29.123301 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7876541a-b176-4d12-b0ed-75424ad96085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:29.126158 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7876541a-b176-4d12-b0ed-75424ad96085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:29.126158 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7876541a-b176-4d12-b0ed-75424ad96085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:29.126711 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7876541a-b176-4d12-b0ed-75424ad96085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:29.290356 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7876541a-b176-4d12-b0ed-75424ad96085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:29.300250 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7876541a-b176-4d12-b0ed-75424ad96085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:29.301840 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7876541a-b176-4d12-b0ed-75424ad96085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:29.303214 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7876541a-b176-4d12-b0ed-75424ad96085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.194417 Jul 18 08:48:29.304723 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 136/257] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:29 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:29.639331 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b8dd2624-c60e-44a0-bc89-af73d70e8731 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:29.639331 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b8dd2624-c60e-44a0-bc89-af73d70e8731 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:29.646950 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b8dd2624-c60e-44a0-bc89-af73d70e8731 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:29.647816 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b8dd2624-c60e-44a0-bc89-af73d70e8731 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:29.648734 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b8dd2624-c60e-44a0-bc89-af73d70e8731 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:29.649520 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b8dd2624-c60e-44a0-bc89-af73d70e8731 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:29.806982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b8dd2624-c60e-44a0-bc89-af73d70e8731 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:29.815919 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b8dd2624-c60e-44a0-bc89-af73d70e8731 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.195530 Jul 18 08:48:29.816507 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 137/258] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:29 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:30.017875 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d293661b-833b-45b9-b279-7ba05459cafb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:30.018406 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d293661b-833b-45b9-b279-7ba05459cafb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:30.024963 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d293661b-833b-45b9-b279-7ba05459cafb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:30.025445 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d293661b-833b-45b9-b279-7ba05459cafb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:30.026324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d293661b-833b-45b9-b279-7ba05459cafb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:30.026770 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d293661b-833b-45b9-b279-7ba05459cafb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:30.182698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d293661b-833b-45b9-b279-7ba05459cafb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:30.192003 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d293661b-833b-45b9-b279-7ba05459cafb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.178164 Jul 18 08:48:30.192611 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 138/259] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:30 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:30.329632 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8598f95c-cfee-411d-92cf-1bfffb3f83fa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:30.330468 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8598f95c-cfee-411d-92cf-1bfffb3f83fa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:30.338402 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8598f95c-cfee-411d-92cf-1bfffb3f83fa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:30.338862 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8598f95c-cfee-411d-92cf-1bfffb3f83fa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:30.339908 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8598f95c-cfee-411d-92cf-1bfffb3f83fa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:30.340345 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8598f95c-cfee-411d-92cf-1bfffb3f83fa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:30.497182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8598f95c-cfee-411d-92cf-1bfffb3f83fa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:30.506271 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8598f95c-cfee-411d-92cf-1bfffb3f83fa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:30.507847 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8598f95c-cfee-411d-92cf-1bfffb3f83fa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:30.510142 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8598f95c-cfee-411d-92cf-1bfffb3f83fa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.186670 Jul 18 08:48:30.510721 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 139/260] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:30 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:30.834999 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b2940bb6-187a-4aaa-91a8-937f1a3d9205 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:30.835692 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b2940bb6-187a-4aaa-91a8-937f1a3d9205 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:30.848519 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b2940bb6-187a-4aaa-91a8-937f1a3d9205 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:30.854783 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b2940bb6-187a-4aaa-91a8-937f1a3d9205 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:30.854783 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b2940bb6-187a-4aaa-91a8-937f1a3d9205 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:30.854783 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b2940bb6-187a-4aaa-91a8-937f1a3d9205 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:30.953618 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] validate_networks() for [('91d2b33d-7b11-4b88-9cd3-44537bfe048d', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:48:31.035304 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b2940bb6-187a-4aaa-91a8-937f1a3d9205 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:31.043306 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b2940bb6-187a-4aaa-91a8-937f1a3d9205 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.212196 Jul 18 08:48:31.053226 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 140/261] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:30 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:31.214783 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-55bf45c8-40a1-4948-9716-02d4c6142cf9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:31.215974 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-55bf45c8-40a1-4948-9716-02d4c6142cf9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:31.227222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-55bf45c8-40a1-4948-9716-02d4c6142cf9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:31.228168 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-55bf45c8-40a1-4948-9716-02d4c6142cf9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:31.229564 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-55bf45c8-40a1-4948-9716-02d4c6142cf9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:31.230286 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-55bf45c8-40a1-4948-9716-02d4c6142cf9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:31.469210 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-55bf45c8-40a1-4948-9716-02d4c6142cf9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:31.479155 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-55bf45c8-40a1-4948-9716-02d4c6142cf9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.271644 Jul 18 08:48:31.479776 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 141/262] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:31 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:31.511072 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:48:31.511490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:48:31.512742 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:48:31.522231 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:48:31.522231 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:48:31.523393 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:31.523909 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:31.524724 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:31.525163 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:31.533619 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c8a324c3-fdcc-4c18-aba4-0775d82bae32 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:31.534826 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c8a324c3-fdcc-4c18-aba4-0775d82bae32 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:31.544299 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:48:31.545750 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8a324c3-fdcc-4c18-aba4-0775d82bae32 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:31.546628 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8a324c3-fdcc-4c18-aba4-0775d82bae32 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:31.548164 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8a324c3-fdcc-4c18-aba4-0775d82bae32 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:31.549043 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8a324c3-fdcc-4c18-aba4-0775d82bae32 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:31.549208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for user 4e6b788e0819483580c09902a341ea6d and project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:48:31.564328 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:48:31.566901 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:48:31.738300 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c8a324c3-fdcc-4c18-aba4-0775d82bae32 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:31.755362 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c8a324c3-fdcc-4c18-aba4-0775d82bae32 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:31.758654 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c8a324c3-fdcc-4c18-aba4-0775d82bae32 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:31.760981 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c8a324c3-fdcc-4c18-aba4-0775d82bae32 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.234284 Jul 18 08:48:31.771107 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 142/263] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:31 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:31.834711 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8063dacd-b132-48ff-bdb8-c7b8db6c4357 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.069991 Jul 18 08:48:31.836166 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 122/264] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:48:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 5073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 08:48:31.848258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-68485e61-7f64-4a4d-81fb-83144dd43977 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:31.849092 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-68485e61-7f64-4a4d-81fb-83144dd43977 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:31.932460 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-68485e61-7f64-4a4d-81fb-83144dd43977 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:31.940015 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-68485e61-7f64-4a4d-81fb-83144dd43977 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1240 microversion: 2.1 time: 0.096153 Jul 18 08:48:31.940973 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 143/265] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:31 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:32.061799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e148baf6-5b7b-4c58-aadf-55ea92fcb338 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:32.062680 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e148baf6-5b7b-4c58-aadf-55ea92fcb338 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:32.073176 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e148baf6-5b7b-4c58-aadf-55ea92fcb338 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:32.073628 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e148baf6-5b7b-4c58-aadf-55ea92fcb338 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:32.074452 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e148baf6-5b7b-4c58-aadf-55ea92fcb338 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:32.074898 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e148baf6-5b7b-4c58-aadf-55ea92fcb338 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:32.262807 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e148baf6-5b7b-4c58-aadf-55ea92fcb338 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:32.271545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e148baf6-5b7b-4c58-aadf-55ea92fcb338 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.214911 Jul 18 08:48:32.278870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 123/266] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:32 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:32.507256 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-fba06df8-c5dd-4c05-9923-b4bc6dfcbc1c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:32.508074 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-fba06df8-c5dd-4c05-9923-b4bc6dfcbc1c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:32.518150 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fba06df8-c5dd-4c05-9923-b4bc6dfcbc1c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:32.518611 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fba06df8-c5dd-4c05-9923-b4bc6dfcbc1c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:32.519412 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fba06df8-c5dd-4c05-9923-b4bc6dfcbc1c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:32.519931 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fba06df8-c5dd-4c05-9923-b4bc6dfcbc1c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:32.682380 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-fba06df8-c5dd-4c05-9923-b4bc6dfcbc1c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:32.692374 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-fba06df8-c5dd-4c05-9923-b4bc6dfcbc1c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.190718 Jul 18 08:48:32.692976 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 144/267] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:32 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:32.790463 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-aea71908-2813-48e8-904e-d3000dd6aa58 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:32.791461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-aea71908-2813-48e8-904e-d3000dd6aa58 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:32.800545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aea71908-2813-48e8-904e-d3000dd6aa58 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:32.801310 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aea71908-2813-48e8-904e-d3000dd6aa58 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:32.802548 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aea71908-2813-48e8-904e-d3000dd6aa58 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:32.803576 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aea71908-2813-48e8-904e-d3000dd6aa58 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:32.969248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-40c99c75-d47e-4755-bdd5-72a675f13378 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:32.970007 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-40c99c75-d47e-4755-bdd5-72a675f13378 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:32.977293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-40c99c75-d47e-4755-bdd5-72a675f13378 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:32.977961 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-40c99c75-d47e-4755-bdd5-72a675f13378 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:32.978964 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-40c99c75-d47e-4755-bdd5-72a675f13378 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:32.979370 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-40c99c75-d47e-4755-bdd5-72a675f13378 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:32.998426 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-aea71908-2813-48e8-904e-d3000dd6aa58 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:33.013753 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-aea71908-2813-48e8-904e-d3000dd6aa58 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:33.015991 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-aea71908-2813-48e8-904e-d3000dd6aa58 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:33.018514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-aea71908-2813-48e8-904e-d3000dd6aa58 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.231332 Jul 18 08:48:33.019783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 124/268] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:32 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:33.071797 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-40c99c75-d47e-4755-bdd5-72a675f13378 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:33.083056 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-40c99c75-d47e-4755-bdd5-72a675f13378 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1244 microversion: 2.1 time: 0.118479 Jul 18 08:48:33.084010 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 145/269] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:32 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1244 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:33.296091 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-55e98c1a-ab25-4f20-9484-d32c0d20dc74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:33.296906 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-55e98c1a-ab25-4f20-9484-d32c0d20dc74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:33.303303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55e98c1a-ab25-4f20-9484-d32c0d20dc74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:33.303778 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55e98c1a-ab25-4f20-9484-d32c0d20dc74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:33.304621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55e98c1a-ab25-4f20-9484-d32c0d20dc74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:33.305053 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55e98c1a-ab25-4f20-9484-d32c0d20dc74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:33.679925 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-55e98c1a-ab25-4f20-9484-d32c0d20dc74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:33.692141 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-55e98c1a-ab25-4f20-9484-d32c0d20dc74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.401248 Jul 18 08:48:33.692754 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 125/270] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:33 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:33.717690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5a75da71-73f4-47fd-931a-023ad3a12772 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:33.718716 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5a75da71-73f4-47fd-931a-023ad3a12772 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:33.726808 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5a75da71-73f4-47fd-931a-023ad3a12772 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:33.727432 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5a75da71-73f4-47fd-931a-023ad3a12772 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:33.728433 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5a75da71-73f4-47fd-931a-023ad3a12772 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:33.729201 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5a75da71-73f4-47fd-931a-023ad3a12772 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:33.921582 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5a75da71-73f4-47fd-931a-023ad3a12772 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:33.937759 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5a75da71-73f4-47fd-931a-023ad3a12772 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.225637 Jul 18 08:48:33.942982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 146/271] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:33 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:34.041766 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0be11bdf-bf45-4bbb-84bb-aaa9915291cc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:34.042460 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0be11bdf-bf45-4bbb-84bb-aaa9915291cc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:34.050570 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0be11bdf-bf45-4bbb-84bb-aaa9915291cc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:34.051017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0be11bdf-bf45-4bbb-84bb-aaa9915291cc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:34.051828 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0be11bdf-bf45-4bbb-84bb-aaa9915291cc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:34.052269 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0be11bdf-bf45-4bbb-84bb-aaa9915291cc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:34.106641 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3afc5624-a57b-4f09-a146-0f5594781916 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:34.107659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-3afc5624-a57b-4f09-a146-0f5594781916 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:34.117541 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3afc5624-a57b-4f09-a146-0f5594781916 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:34.119878 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3afc5624-a57b-4f09-a146-0f5594781916 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:34.119878 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3afc5624-a57b-4f09-a146-0f5594781916 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:34.120544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3afc5624-a57b-4f09-a146-0f5594781916 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:34.259279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-3afc5624-a57b-4f09-a146-0f5594781916 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:34.276253 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-3afc5624-a57b-4f09-a146-0f5594781916 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1236 microversion: 2.1 time: 0.175981 Jul 18 08:48:34.286061 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0be11bdf-bf45-4bbb-84bb-aaa9915291cc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:34.289632 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 147/272] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:34 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1236 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:34.311705 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0be11bdf-bf45-4bbb-84bb-aaa9915291cc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:34.311705 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0be11bdf-bf45-4bbb-84bb-aaa9915291cc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:34.311705 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0be11bdf-bf45-4bbb-84bb-aaa9915291cc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.270926 Jul 18 08:48:34.319853 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 126/273] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:34 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:34.722279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8411cb4e-30ec-43d7-83b2-f3cb269d2030 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:34.722893 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8411cb4e-30ec-43d7-83b2-f3cb269d2030 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:34.732847 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8411cb4e-30ec-43d7-83b2-f3cb269d2030 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:34.733563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8411cb4e-30ec-43d7-83b2-f3cb269d2030 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:34.734805 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8411cb4e-30ec-43d7-83b2-f3cb269d2030 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:34.735467 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8411cb4e-30ec-43d7-83b2-f3cb269d2030 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:34.910847 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8411cb4e-30ec-43d7-83b2-f3cb269d2030 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:34.920416 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8411cb4e-30ec-43d7-83b2-f3cb269d2030 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1500 microversion: 2.1 time: 0.202875 Jul 18 08:48:34.921046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 148/274] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:34 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1500 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:34.945915 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-62a3edeb-a98a-4b52-a575-86173251aa69 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0924e2a8-be63-43dd-a90a-c89b2cb08b01"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:34.949256 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-62a3edeb-a98a-4b52-a575-86173251aa69 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:34.965954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a7db3624-49ad-4e7e-bfa5-6da7802c5817 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:34.966958 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a7db3624-49ad-4e7e-bfa5-6da7802c5817 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:34.967333 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-62a3edeb-a98a-4b52-a575-86173251aa69 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:34.968646 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-62a3edeb-a98a-4b52-a575-86173251aa69 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:34.970113 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-62a3edeb-a98a-4b52-a575-86173251aa69 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:34.970858 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-62a3edeb-a98a-4b52-a575-86173251aa69 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:34.982167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a7db3624-49ad-4e7e-bfa5-6da7802c5817 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:34.982911 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a7db3624-49ad-4e7e-bfa5-6da7802c5817 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:34.984271 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a7db3624-49ad-4e7e-bfa5-6da7802c5817 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:34.985087 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a7db3624-49ad-4e7e-bfa5-6da7802c5817 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:35.009090 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-62a3edeb-a98a-4b52-a575-86173251aa69 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] HTTP exception thrown: Cannot 'attach_volume' instance 75cd9ec0-94a9-4043-983e-d876084556ad while it is in vm_state rescued Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-62a3edeb-a98a-4b52-a575-86173251aa69 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Request method failure captured: Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: POST /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad/os-volume_attachments HTTP/1.1 Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 74 Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3dPNM7loaJvWicYRxKNa0h2dELfsNCPBqGOVbM4VjyGgJ8YI3dpOKCRIG5ADhj0bk2Bwryh-K90h_Jd2S_dfzg6t89cOJ8oymbW0JrDzOPUwdA8pKjvNq7gMlvwLqdNYbV-dQFiRSW1qJ2dH3Y8KvvCxUHLV49BOovZ4stJNLcNu8 Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: c2f44b51cc624637bccd9ed1d3b1a769 Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:48:35.011793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2f44b51cc624637bccd9ed1d3b1a769", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: c2f44b51cc624637bccd9ed1d3b1a769 Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-ServerRescueNegativeTestJSON-220645641-project Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 56b3d8d145d94b358c86345eb5c3b306 Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-ServerRescueNegativeTestJSON-220645641-project Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {"volumeAttachment": {"volumeId": "0924e2a8-be63-43dd-a90a-c89b2cb08b01"}} Jul 18 08:48:35.014051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Cannot 'attach_volume' instance 75cd9ec0-94a9-4043-983e-d876084556ad while it is in vm_state rescued Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'server_id': '75cd9ec0-94a9-4043-983e-d876084556ad', 'body': {'volumeAttachment': {'volumeId': '0924e2a8-be63-43dd-a90a-c89b2cb08b01'}}} Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 75cd9ec0-94a9-4043-983e-d876084556ad in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:48:35.014860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 75cd9ec0-94a9-4043-983e-d876084556ad while it is in vm_state rescued Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:48:35.016040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:48:35.018049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:48:35.018049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:48:35.018049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 75cd9ec0-94a9-4043-983e-d876084556ad while it is in vm_state rescued Jul 18 08:48:35.018049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:48:35.020208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-62a3edeb-a98a-4b52-a575-86173251aa69 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Returning 409 to user: Cannot 'attach_volume' instance 75cd9ec0-94a9-4043-983e-d876084556ad while it is in vm_state rescued {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:48:35.021331 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-62a3edeb-a98a-4b52-a575-86173251aa69 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "POST /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.084188 Jul 18 08:48:35.021930 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 127/275] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:48:34 2022] POST /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad/os-volume_attachments => generated 152 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 08:48:35.041154 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-10f289d3-d97b-41ef-adf9-4060d70ba33b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:35.041797 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-10f289d3-d97b-41ef-adf9-4060d70ba33b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:35.052697 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10f289d3-d97b-41ef-adf9-4060d70ba33b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:35.053031 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10f289d3-d97b-41ef-adf9-4060d70ba33b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:35.053821 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10f289d3-d97b-41ef-adf9-4060d70ba33b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:35.054421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10f289d3-d97b-41ef-adf9-4060d70ba33b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:35.082869 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=100 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:35.200969 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a7db3624-49ad-4e7e-bfa5-6da7802c5817 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:35.212555 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a7db3624-49ad-4e7e-bfa5-6da7802c5817 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.253759 Jul 18 08:48:35.213066 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 149/276] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:34 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:35.323464 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-84dfecaa-0a66-4b2e-93b7-b52dbc545c76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:35.324369 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-84dfecaa-0a66-4b2e-93b7-b52dbc545c76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:35.331571 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-84dfecaa-0a66-4b2e-93b7-b52dbc545c76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:35.332060 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-84dfecaa-0a66-4b2e-93b7-b52dbc545c76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:35.332841 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-84dfecaa-0a66-4b2e-93b7-b52dbc545c76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:35.333335 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-84dfecaa-0a66-4b2e-93b7-b52dbc545c76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:35.406522 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-84dfecaa-0a66-4b2e-93b7-b52dbc545c76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:35.414421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-10f289d3-d97b-41ef-adf9-4060d70ba33b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "POST /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad/action" status: 202 len: 0 microversion: 2.1 time: 0.378857 Jul 18 08:48:35.422427 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 128/277] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:48:35 2022] POST /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:48:35.422594 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-84dfecaa-0a66-4b2e-93b7-b52dbc545c76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1292 microversion: 2.1 time: 0.096147 Jul 18 08:48:35.422594 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 150/278] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:35 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:35.422886 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-10060671-267e-4c5d-a8ef-207c03833648 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:35.422886 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-10060671-267e-4c5d-a8ef-207c03833648 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:35.431048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c38df4d4-24c5-4b98-8023-1430a2baa84d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:35.431889 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c38df4d4-24c5-4b98-8023-1430a2baa84d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:35.432002 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10060671-267e-4c5d-a8ef-207c03833648 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:35.432559 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10060671-267e-4c5d-a8ef-207c03833648 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:35.434076 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10060671-267e-4c5d-a8ef-207c03833648 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:35.434236 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10060671-267e-4c5d-a8ef-207c03833648 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:35.439267 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c38df4d4-24c5-4b98-8023-1430a2baa84d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:35.439752 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c38df4d4-24c5-4b98-8023-1430a2baa84d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:35.440632 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c38df4d4-24c5-4b98-8023-1430a2baa84d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:35.441100 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c38df4d4-24c5-4b98-8023-1430a2baa84d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:35.636237 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-10060671-267e-4c5d-a8ef-207c03833648 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:35.646620 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-10060671-267e-4c5d-a8ef-207c03833648 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:35.648115 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-10060671-267e-4c5d-a8ef-207c03833648 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:35.649340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-10060671-267e-4c5d-a8ef-207c03833648 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.232923 Jul 18 08:48:35.649920 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 129/279] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:35 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:35.678725 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c38df4d4-24c5-4b98-8023-1430a2baa84d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:35.682284 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=100 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:35.692955 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c38df4d4-24c5-4b98-8023-1430a2baa84d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1508 microversion: 2.1 time: 0.267498 Jul 18 08:48:35.694148 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 151/280] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:35 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:36.234061 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9f52747e-67d4-4c2d-913c-a7aea2fc3718 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:36.237081 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9f52747e-67d4-4c2d-913c-a7aea2fc3718 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:36.245077 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9f52747e-67d4-4c2d-913c-a7aea2fc3718 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:36.245655 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9f52747e-67d4-4c2d-913c-a7aea2fc3718 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:36.246775 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9f52747e-67d4-4c2d-913c-a7aea2fc3718 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:36.248006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9f52747e-67d4-4c2d-913c-a7aea2fc3718 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:36.437992 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d36a105c-2280-4307-843e-64a2d3106f74 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:36.439498 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d36a105c-2280-4307-843e-64a2d3106f74 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:36.449966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d36a105c-2280-4307-843e-64a2d3106f74 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:36.450552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d36a105c-2280-4307-843e-64a2d3106f74 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:36.451419 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d36a105c-2280-4307-843e-64a2d3106f74 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:36.452131 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d36a105c-2280-4307-843e-64a2d3106f74 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:36.498318 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9f52747e-67d4-4c2d-913c-a7aea2fc3718 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:36.515869 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9f52747e-67d4-4c2d-913c-a7aea2fc3718 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.288827 Jul 18 08:48:36.516868 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 130/281] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:36 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:36.533839 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d36a105c-2280-4307-843e-64a2d3106f74 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:36.544224 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d36a105c-2280-4307-843e-64a2d3106f74 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1298 microversion: 2.1 time: 0.113079 Jul 18 08:48:36.560004 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 152/282] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:36 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:36.677079 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-78ecb309-ccbd-442b-b2aa-173513660f47 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:36.677700 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-78ecb309-ccbd-442b-b2aa-173513660f47 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:36.685384 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-78ecb309-ccbd-442b-b2aa-173513660f47 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:36.686069 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-78ecb309-ccbd-442b-b2aa-173513660f47 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:36.686840 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-78ecb309-ccbd-442b-b2aa-173513660f47 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:36.687463 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-78ecb309-ccbd-442b-b2aa-173513660f47 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:36.718833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5ffa8c7f-46df-49f6-b6e3-b6b7e0473b85 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:36.719497 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5ffa8c7f-46df-49f6-b6e3-b6b7e0473b85 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:36.725879 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ffa8c7f-46df-49f6-b6e3-b6b7e0473b85 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:36.726629 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ffa8c7f-46df-49f6-b6e3-b6b7e0473b85 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:36.727854 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ffa8c7f-46df-49f6-b6e3-b6b7e0473b85 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:36.728640 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ffa8c7f-46df-49f6-b6e3-b6b7e0473b85 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:36.894610 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5ffa8c7f-46df-49f6-b6e3-b6b7e0473b85 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:36.903922 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5ffa8c7f-46df-49f6-b6e3-b6b7e0473b85 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1508 microversion: 2.1 time: 0.190607 Jul 18 08:48:36.904853 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 153/283] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:36 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:36.909245 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-78ecb309-ccbd-442b-b2aa-173513660f47 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:36.917605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-78ecb309-ccbd-442b-b2aa-173513660f47 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:36.920211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-78ecb309-ccbd-442b-b2aa-173513660f47 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:36.921471 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-78ecb309-ccbd-442b-b2aa-173513660f47 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1744 microversion: 2.20 time: 0.251635 Jul 18 08:48:36.925221 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 131/284] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:36 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1744 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:37.534642 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a76e7e37-940f-43fd-8940-b036429580d5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:37.535258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a76e7e37-940f-43fd-8940-b036429580d5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:37.541823 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a76e7e37-940f-43fd-8940-b036429580d5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:37.545570 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a76e7e37-940f-43fd-8940-b036429580d5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:37.545570 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a76e7e37-940f-43fd-8940-b036429580d5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:37.545570 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a76e7e37-940f-43fd-8940-b036429580d5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:37.567578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f20a85c3-1a52-4ce1-8870-8bf2616ebeb5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:37.568265 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f20a85c3-1a52-4ce1-8870-8bf2616ebeb5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:37.577635 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f20a85c3-1a52-4ce1-8870-8bf2616ebeb5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:37.578345 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f20a85c3-1a52-4ce1-8870-8bf2616ebeb5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:37.579286 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f20a85c3-1a52-4ce1-8870-8bf2616ebeb5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:37.579630 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f20a85c3-1a52-4ce1-8870-8bf2616ebeb5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:37.712595 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a76e7e37-940f-43fd-8940-b036429580d5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:37.721480 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a76e7e37-940f-43fd-8940-b036429580d5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.190765 Jul 18 08:48:37.722074 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 154/285] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:37 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:37.748259 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f20a85c3-1a52-4ce1-8870-8bf2616ebeb5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:37.756330 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f20a85c3-1a52-4ce1-8870-8bf2616ebeb5 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1366 microversion: 2.1 time: 0.192419 Jul 18 08:48:37.756913 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 132/286] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:37 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:37.921979 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7738ba87-584a-473d-af0a-0b74d87a3f0d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:37.922618 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7738ba87-584a-473d-af0a-0b74d87a3f0d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:37.928864 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7738ba87-584a-473d-af0a-0b74d87a3f0d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:37.929307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7738ba87-584a-473d-af0a-0b74d87a3f0d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:37.930082 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7738ba87-584a-473d-af0a-0b74d87a3f0d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:37.930510 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7738ba87-584a-473d-af0a-0b74d87a3f0d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:37.945055 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1bda59de-9e0d-466d-be3d-0db1067cd01d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:37.945665 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1bda59de-9e0d-466d-be3d-0db1067cd01d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:37.953248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1bda59de-9e0d-466d-be3d-0db1067cd01d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:37.953708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1bda59de-9e0d-466d-be3d-0db1067cd01d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:37.954494 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1bda59de-9e0d-466d-be3d-0db1067cd01d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:37.954934 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1bda59de-9e0d-466d-be3d-0db1067cd01d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:38.082557 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7738ba87-584a-473d-af0a-0b74d87a3f0d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:38.092680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7738ba87-584a-473d-af0a-0b74d87a3f0d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1508 microversion: 2.1 time: 0.175421 Jul 18 08:48:38.093455 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 155/287] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:37 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:38.101635 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1bda59de-9e0d-466d-be3d-0db1067cd01d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:38.110672 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1bda59de-9e0d-466d-be3d-0db1067cd01d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:38.112198 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1bda59de-9e0d-466d-be3d-0db1067cd01d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:38.113468 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1bda59de-9e0d-466d-be3d-0db1067cd01d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1744 microversion: 2.20 time: 0.172331 Jul 18 08:48:38.114024 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 133/288] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:37 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:38.741615 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8fecedd7-1fed-42e8-91ed-85fe508e8a30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:38.746928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8fecedd7-1fed-42e8-91ed-85fe508e8a30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:38.753875 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8fecedd7-1fed-42e8-91ed-85fe508e8a30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:38.754619 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8fecedd7-1fed-42e8-91ed-85fe508e8a30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:38.755733 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8fecedd7-1fed-42e8-91ed-85fe508e8a30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:38.756442 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8fecedd7-1fed-42e8-91ed-85fe508e8a30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:38.776397 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c1866e84-e9aa-4555-b8dd-0132b73d2c01 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:38.778334 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c1866e84-e9aa-4555-b8dd-0132b73d2c01 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:38.791707 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1866e84-e9aa-4555-b8dd-0132b73d2c01 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:38.793884 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1866e84-e9aa-4555-b8dd-0132b73d2c01 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:38.796289 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1866e84-e9aa-4555-b8dd-0132b73d2c01 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:38.799204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1866e84-e9aa-4555-b8dd-0132b73d2c01 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:38.968240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8fecedd7-1fed-42e8-91ed-85fe508e8a30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:38.979110 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8fecedd7-1fed-42e8-91ed-85fe508e8a30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1724 microversion: 2.1 time: 0.241063 Jul 18 08:48:38.982572 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 156/289] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:38 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:38.996048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-4bc1b839-7ca2-46e0-9a91-32155bb9300a req-f02ade69-f8df-4e9c-8040-ab90e10ccf99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d6245b-0c6d-4a19-85c6-841d85912f2e", "name": "network-vif-plugged", "status": "completed", "tag": "222385f0-b84b-466b-a9f5-dab4e9dadd74"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:39.007408 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-4bc1b839-7ca2-46e0-9a91-32155bb9300a req-f02ade69-f8df-4e9c-8040-ab90e10ccf99 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:39.007886 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-4bc1b839-7ca2-46e0-9a91-32155bb9300a req-f02ade69-f8df-4e9c-8040-ab90e10ccf99 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:39.023556 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-4bc1b839-7ca2-46e0-9a91-32155bb9300a req-f02ade69-f8df-4e9c-8040-ab90e10ccf99 service nova] Creating event network-vif-plugged:222385f0-b84b-466b-a9f5-dab4e9dadd74 for instance f3d6245b-0c6d-4a19-85c6-841d85912f2e on hv-cinder-85014 Jul 18 08:48:39.030504 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-4bc1b839-7ca2-46e0-9a91-32155bb9300a req-f02ade69-f8df-4e9c-8040-ab90e10ccf99 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046268 Jul 18 08:48:39.032185 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 157/290] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:48:39.102639 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c1866e84-e9aa-4555-b8dd-0132b73d2c01 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:39.110770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c1866e84-e9aa-4555-b8dd-0132b73d2c01 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1366 microversion: 2.1 time: 0.338936 Jul 18 08:48:39.110974 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0d33b4b4-8323-4869-b06d-e10847a4d050 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:39.120853 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 134/291] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:38 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:39.121096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0d33b4b4-8323-4869-b06d-e10847a4d050 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:39.121096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0d33b4b4-8323-4869-b06d-e10847a4d050 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:39.121096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0d33b4b4-8323-4869-b06d-e10847a4d050 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:39.121096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0d33b4b4-8323-4869-b06d-e10847a4d050 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:39.121449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0d33b4b4-8323-4869-b06d-e10847a4d050 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:39.133486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-60e75290-052c-45a6-833f-b5a4f3d34d37 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:39.134109 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-60e75290-052c-45a6-833f-b5a4f3d34d37 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:39.140782 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60e75290-052c-45a6-833f-b5a4f3d34d37 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:39.141234 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60e75290-052c-45a6-833f-b5a4f3d34d37 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:39.142015 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60e75290-052c-45a6-833f-b5a4f3d34d37 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:39.142607 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60e75290-052c-45a6-833f-b5a4f3d34d37 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:39.289096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0d33b4b4-8323-4869-b06d-e10847a4d050 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:39.299111 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0d33b4b4-8323-4869-b06d-e10847a4d050 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1508 microversion: 2.1 time: 0.192253 Jul 18 08:48:39.303359 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-60e75290-052c-45a6-833f-b5a4f3d34d37 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:39.306743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 158/292] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:39 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:39.312970 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-60e75290-052c-45a6-833f-b5a4f3d34d37 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:39.315024 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-60e75290-052c-45a6-833f-b5a4f3d34d37 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:39.316480 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-60e75290-052c-45a6-833f-b5a4f3d34d37 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1744 microversion: 2.20 time: 0.187199 Jul 18 08:48:39.317139 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 135/293] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:39 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:39.726283 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-27e06869-2d9f-4455-af16-da563faa48fa req-9753ad31-6bc2-4fce-bb30-45af1995928c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b5a1195-56c1-4745-8903-f6bba84a4d19", "tag": "bf3b9deb-1402-409e-aeab-b183bf26a42e"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:39.747522 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-27e06869-2d9f-4455-af16-da563faa48fa req-9753ad31-6bc2-4fce-bb30-45af1995928c service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:39.748556 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-27e06869-2d9f-4455-af16-da563faa48fa req-9753ad31-6bc2-4fce-bb30-45af1995928c service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:39.763061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-27e06869-2d9f-4455-af16-da563faa48fa req-9753ad31-6bc2-4fce-bb30-45af1995928c service nova] Creating event network-changed:bf3b9deb-1402-409e-aeab-b183bf26a42e for instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 on hv-cinder-85014 Jul 18 08:48:39.769481 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-27e06869-2d9f-4455-af16-da563faa48fa req-9753ad31-6bc2-4fce-bb30-45af1995928c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050092 Jul 18 08:48:39.769481 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 159/294] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:48:40.001493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-121cd756-80e8-4434-aaaf-e0393f06161f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:40.003493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-121cd756-80e8-4434-aaaf-e0393f06161f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:40.012481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-121cd756-80e8-4434-aaaf-e0393f06161f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:40.013330 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-121cd756-80e8-4434-aaaf-e0393f06161f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:40.014187 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-121cd756-80e8-4434-aaaf-e0393f06161f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:40.014630 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-121cd756-80e8-4434-aaaf-e0393f06161f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:40.131533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-01c58050-ca5b-49cf-858f-aa5e079009ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:40.134260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-01c58050-ca5b-49cf-858f-aa5e079009ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:40.140169 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-01c58050-ca5b-49cf-858f-aa5e079009ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:40.140627 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-01c58050-ca5b-49cf-858f-aa5e079009ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:40.141576 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-01c58050-ca5b-49cf-858f-aa5e079009ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:40.141990 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-01c58050-ca5b-49cf-858f-aa5e079009ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:40.343472 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-01c58050-ca5b-49cf-858f-aa5e079009ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:40.351437 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-01c58050-ca5b-49cf-858f-aa5e079009ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1366 microversion: 2.1 time: 0.225902 Jul 18 08:48:40.352077 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 160/295] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:40 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:40.357071 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bbcd2e65-176a-435f-abcd-aa197e35f152 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:40.357969 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bbcd2e65-176a-435f-abcd-aa197e35f152 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:40.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbcd2e65-176a-435f-abcd-aa197e35f152 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:40.364981 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbcd2e65-176a-435f-abcd-aa197e35f152 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:40.365772 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbcd2e65-176a-435f-abcd-aa197e35f152 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:40.366211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbcd2e65-176a-435f-abcd-aa197e35f152 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:40.544129 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bbcd2e65-176a-435f-abcd-aa197e35f152 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:40.559725 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bbcd2e65-176a-435f-abcd-aa197e35f152 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1514 microversion: 2.1 time: 0.206422 Jul 18 08:48:40.560970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 161/296] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:40 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:40.572091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a5f2909a-0d40-4d5f-a138-34bd1391b9f3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:40.572721 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a5f2909a-0d40-4d5f-a138-34bd1391b9f3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:40.596064 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a5f2909a-0d40-4d5f-a138-34bd1391b9f3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:40.596468 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a5f2909a-0d40-4d5f-a138-34bd1391b9f3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:40.597245 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a5f2909a-0d40-4d5f-a138-34bd1391b9f3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:40.597692 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a5f2909a-0d40-4d5f-a138-34bd1391b9f3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:40.609347 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-121cd756-80e8-4434-aaaf-e0393f06161f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:40.631721 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-121cd756-80e8-4434-aaaf-e0393f06161f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1701 microversion: 2.1 time: 0.638240 Jul 18 08:48:40.635700 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 136/297] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:39 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1701 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:40.658761 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5d51f675-ae7a-4b84-b1dd-c2630cde15f4 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:40.667400 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5d51f675-ae7a-4b84-b1dd-c2630cde15f4 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:40.668394 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5d51f675-ae7a-4b84-b1dd-c2630cde15f4 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:40.804962 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5d51f675-ae7a-4b84-b1dd-c2630cde15f4 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Going to try to start instance {{(pid=124895) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 08:48:40.978491 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a5f2909a-0d40-4d5f-a138-34bd1391b9f3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:40.999892 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a5f2909a-0d40-4d5f-a138-34bd1391b9f3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:41.002008 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a5f2909a-0d40-4d5f-a138-34bd1391b9f3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:41.003919 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a5f2909a-0d40-4d5f-a138-34bd1391b9f3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.441286 Jul 18 08:48:41.004581 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 162/298] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:40 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:41.120491 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5d51f675-ae7a-4b84-b1dd-c2630cde15f4 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "POST /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/action" status: 202 len: 0 microversion: 2.1 time: 0.444607 Jul 18 08:48:41.120491 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 137/299] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:48:40 2022] POST /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:48:41.121555 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-cc5b18a1-bd3f-45e4-8112-339599326acc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:41.121555 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-cc5b18a1-bd3f-45e4-8112-339599326acc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:41.128623 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cc5b18a1-bd3f-45e4-8112-339599326acc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:41.130179 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cc5b18a1-bd3f-45e4-8112-339599326acc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:41.133678 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cc5b18a1-bd3f-45e4-8112-339599326acc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:41.134606 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cc5b18a1-bd3f-45e4-8112-339599326acc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:41.391837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-245898e8-3fbd-455e-a706-b89ba278814c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:41.403192 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-245898e8-3fbd-455e-a706-b89ba278814c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:41.416433 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-cc5b18a1-bd3f-45e4-8112-339599326acc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:41.427067 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-cc5b18a1-bd3f-45e4-8112-339599326acc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1710 microversion: 2.1 time: 0.319214 Jul 18 08:48:41.457716 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 163/300] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:41 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1710 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:41.457846 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-245898e8-3fbd-455e-a706-b89ba278814c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:41.457846 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-245898e8-3fbd-455e-a706-b89ba278814c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:41.457846 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-245898e8-3fbd-455e-a706-b89ba278814c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:41.457846 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-245898e8-3fbd-455e-a706-b89ba278814c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:41.532612 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:41.561669 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=10 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:41.668888 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-245898e8-3fbd-455e-a706-b89ba278814c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:41.679278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-245898e8-3fbd-455e-a706-b89ba278814c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1366 microversion: 2.1 time: 0.312188 Jul 18 08:48:41.680592 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 138/301] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:41 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:42.037507 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8589f42c-78a0-4807-840b-889f8dce75b5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:42.038135 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8589f42c-78a0-4807-840b-889f8dce75b5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:42.040659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:42.041334 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=100 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:42.046326 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8589f42c-78a0-4807-840b-889f8dce75b5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:42.046780 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8589f42c-78a0-4807-840b-889f8dce75b5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:42.047686 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8589f42c-78a0-4807-840b-889f8dce75b5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:42.048098 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8589f42c-78a0-4807-840b-889f8dce75b5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:42.254475 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8589f42c-78a0-4807-840b-889f8dce75b5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:42.264253 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8589f42c-78a0-4807-840b-889f8dce75b5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:42.266027 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8589f42c-78a0-4807-840b-889f8dce75b5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:42.267599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8589f42c-78a0-4807-840b-889f8dce75b5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.241408 Jul 18 08:48:42.280576 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 164/302] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:42 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:42.451616 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5fa4946f-ad61-4e01-b516-a77c948ee4eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:42.452500 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5fa4946f-ad61-4e01-b516-a77c948ee4eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:42.466514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5fa4946f-ad61-4e01-b516-a77c948ee4eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:42.467337 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5fa4946f-ad61-4e01-b516-a77c948ee4eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:42.468868 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5fa4946f-ad61-4e01-b516-a77c948ee4eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:42.469703 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5fa4946f-ad61-4e01-b516-a77c948ee4eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:42.644545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5fa4946f-ad61-4e01-b516-a77c948ee4eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:42.655323 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5fa4946f-ad61-4e01-b516-a77c948ee4eb tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1710 microversion: 2.1 time: 0.211998 Jul 18 08:48:42.656661 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 139/303] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:42 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1710 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:42.703515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0e75936a-85a9-4b36-be79-a83eba0df5af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:42.704933 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0e75936a-85a9-4b36-be79-a83eba0df5af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:42.757975 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0e75936a-85a9-4b36-be79-a83eba0df5af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:42.759536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0e75936a-85a9-4b36-be79-a83eba0df5af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:42.765213 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0e75936a-85a9-4b36-be79-a83eba0df5af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:42.775099 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0e75936a-85a9-4b36-be79-a83eba0df5af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:42.879106 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-34570724-ae1a-4928-9ae3-127d57030154 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Action: 'create', calling method: .version_select at 0x7fafb7f1cc10>, body: {"keypair": {"name": "tempest-keypair-1318404474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2xnjGUs7Rrd80ps0/mzlEGq0L2lCpxWhRO8htPfIF1A9aTTEhlprelR6UEyJqqscDB9strq1NimuGw2b1jGQ3YfBQ3d6IDPigSa8hqT8sbeqFTlYZebEGIfjmUFLKkzg=="}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:42.918252 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-34570724-ae1a-4928-9ae3-127d57030154 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Getting quotas for project c2f44b51cc624637bccd9ed1d3b1a769. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:48:42.922853 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-34570724-ae1a-4928-9ae3-127d57030154 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Getting quotas for user 56b3d8d145d94b358c86345eb5c3b306 and project c2f44b51cc624637bccd9ed1d3b1a769. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:48:42.929558 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:43.157604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-34570724-ae1a-4928-9ae3-127d57030154 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.279864 Jul 18 08:48:43.157604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 140/304] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 08:48:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:48:43.220129 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0e75936a-85a9-4b36-be79-a83eba0df5af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:43.231952 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0e75936a-85a9-4b36-be79-a83eba0df5af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1366 microversion: 2.1 time: 0.535080 Jul 18 08:48:43.231952 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 165/305] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:42 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1366 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:43.299793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3c6589e0-03e3-466e-adc4-b80a1d7dfe12 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:43.299793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3c6589e0-03e3-466e-adc4-b80a1d7dfe12 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:43.345200 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3c6589e0-03e3-466e-adc4-b80a1d7dfe12 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:43.351330 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3c6589e0-03e3-466e-adc4-b80a1d7dfe12 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:43.351330 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3c6589e0-03e3-466e-adc4-b80a1d7dfe12 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:43.351330 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3c6589e0-03e3-466e-adc4-b80a1d7dfe12 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:43.582407 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3c6589e0-03e3-466e-adc4-b80a1d7dfe12 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:43.601724 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3c6589e0-03e3-466e-adc4-b80a1d7dfe12 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:43.603511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3c6589e0-03e3-466e-adc4-b80a1d7dfe12 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:43.605819 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3c6589e0-03e3-466e-adc4-b80a1d7dfe12 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.320809 Jul 18 08:48:43.607571 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 141/306] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:43 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:43.675310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ed6b2e1b-ee90-4f83-9a64-781b977944ef tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:43.676566 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ed6b2e1b-ee90-4f83-9a64-781b977944ef tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:43.687381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ed6b2e1b-ee90-4f83-9a64-781b977944ef tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:43.688167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ed6b2e1b-ee90-4f83-9a64-781b977944ef tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:43.689171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ed6b2e1b-ee90-4f83-9a64-781b977944ef tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:43.689657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ed6b2e1b-ee90-4f83-9a64-781b977944ef tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:43.915568 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ed6b2e1b-ee90-4f83-9a64-781b977944ef tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:43.938299 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ed6b2e1b-ee90-4f83-9a64-781b977944ef tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1710 microversion: 2.1 time: 0.267763 Jul 18 08:48:43.941908 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 166/307] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:43 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1710 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:44.249081 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f42e213a-dd34-43b3-a3e3-ba0642526309 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:44.249803 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f42e213a-dd34-43b3-a3e3-ba0642526309 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:44.268188 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f42e213a-dd34-43b3-a3e3-ba0642526309 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:44.269389 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f42e213a-dd34-43b3-a3e3-ba0642526309 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:44.271101 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f42e213a-dd34-43b3-a3e3-ba0642526309 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:44.272191 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f42e213a-dd34-43b3-a3e3-ba0642526309 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:44.503961 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f42e213a-dd34-43b3-a3e3-ba0642526309 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:44.516139 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f42e213a-dd34-43b3-a3e3-ba0642526309 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1366 microversion: 2.1 time: 0.271124 Jul 18 08:48:44.517749 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 142/308] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:44 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:44.645307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-40618caf-767c-4c9f-b0dc-85ae457df11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:44.647911 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-40618caf-767c-4c9f-b0dc-85ae457df11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:44.682820 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-40618caf-767c-4c9f-b0dc-85ae457df11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:44.684599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-40618caf-767c-4c9f-b0dc-85ae457df11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:44.686223 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-40618caf-767c-4c9f-b0dc-85ae457df11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:44.687176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-40618caf-767c-4c9f-b0dc-85ae457df11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:44.975976 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-69ca67b8-809e-4f0a-b714-8c71b3fc0e68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:44.977339 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-69ca67b8-809e-4f0a-b714-8c71b3fc0e68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:45.004257 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-69ca67b8-809e-4f0a-b714-8c71b3fc0e68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:45.005267 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-69ca67b8-809e-4f0a-b714-8c71b3fc0e68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:45.010146 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-69ca67b8-809e-4f0a-b714-8c71b3fc0e68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:45.013574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-69ca67b8-809e-4f0a-b714-8c71b3fc0e68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:45.178287 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-40618caf-767c-4c9f-b0dc-85ae457df11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:45.191043 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-40618caf-767c-4c9f-b0dc-85ae457df11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:45.198481 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-40618caf-767c-4c9f-b0dc-85ae457df11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:45.200362 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-40618caf-767c-4c9f-b0dc-85ae457df11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.566445 Jul 18 08:48:45.200954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 167/309] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:44 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:45.309387 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-69ca67b8-809e-4f0a-b714-8c71b3fc0e68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:45.312451 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:45.320310 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-69ca67b8-809e-4f0a-b714-8c71b3fc0e68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1710 microversion: 2.1 time: 0.361466 Jul 18 08:48:45.329388 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 143/310] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:44 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1710 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:45.536752 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1b77c8c3-c7c3-4d9e-ad14-48a4598e1819 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:45.537834 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1b77c8c3-c7c3-4d9e-ad14-48a4598e1819 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:45.549325 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1b77c8c3-c7c3-4d9e-ad14-48a4598e1819 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:45.550072 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1b77c8c3-c7c3-4d9e-ad14-48a4598e1819 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:45.552457 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1b77c8c3-c7c3-4d9e-ad14-48a4598e1819 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:45.553161 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1b77c8c3-c7c3-4d9e-ad14-48a4598e1819 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:45.813390 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1b77c8c3-c7c3-4d9e-ad14-48a4598e1819 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:45.813390 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1b77c8c3-c7c3-4d9e-ad14-48a4598e1819 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1366 microversion: 2.1 time: 0.278512 Jul 18 08:48:45.816176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 168/311] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:45 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:46.246959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6e93e6ea-04bb-40fd-8391-95e0ccf4ccf1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:46.246959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-6e93e6ea-04bb-40fd-8391-95e0ccf4ccf1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:46.261851 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6e93e6ea-04bb-40fd-8391-95e0ccf4ccf1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:46.263862 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6e93e6ea-04bb-40fd-8391-95e0ccf4ccf1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:46.267187 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6e93e6ea-04bb-40fd-8391-95e0ccf4ccf1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:46.269119 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6e93e6ea-04bb-40fd-8391-95e0ccf4ccf1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:46.343881 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-325104d4-8397-4860-941c-148976a6ba4b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:46.351552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-325104d4-8397-4860-941c-148976a6ba4b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:46.388630 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-325104d4-8397-4860-941c-148976a6ba4b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:46.391267 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-325104d4-8397-4860-941c-148976a6ba4b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:46.396567 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-325104d4-8397-4860-941c-148976a6ba4b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:46.397648 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-325104d4-8397-4860-941c-148976a6ba4b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:46.602702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6e93e6ea-04bb-40fd-8391-95e0ccf4ccf1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:46.630573 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6e93e6ea-04bb-40fd-8391-95e0ccf4ccf1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:46.648767 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6e93e6ea-04bb-40fd-8391-95e0ccf4ccf1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:46.654755 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-6e93e6ea-04bb-40fd-8391-95e0ccf4ccf1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.429820 Jul 18 08:48:46.655862 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 144/312] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:46 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:46.832677 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d9fafd6e-484f-4cda-81a2-fc9e96f7e5d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:46.841152 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d9fafd6e-484f-4cda-81a2-fc9e96f7e5d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:46.889765 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d9fafd6e-484f-4cda-81a2-fc9e96f7e5d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:46.893837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d9fafd6e-484f-4cda-81a2-fc9e96f7e5d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:46.893837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d9fafd6e-484f-4cda-81a2-fc9e96f7e5d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:46.894925 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d9fafd6e-484f-4cda-81a2-fc9e96f7e5d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:47.019721 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-325104d4-8397-4860-941c-148976a6ba4b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:47.025623 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=100 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:48:47.030201 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-325104d4-8397-4860-941c-148976a6ba4b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1710 microversion: 2.1 time: 0.693869 Jul 18 08:48:47.040898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 169/313] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:46 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1710 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:47.126354 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d9fafd6e-484f-4cda-81a2-fc9e96f7e5d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:47.148543 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d9fafd6e-484f-4cda-81a2-fc9e96f7e5d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1366 microversion: 2.1 time: 0.324453 Jul 18 08:48:47.159032 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 145/314] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:46 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:47.558324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-29744977", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7493bcf7-a4b9-4c49-a680-3a0a798b3b98"}], "security_groups": [{"name": "tempest-securitygroup--1921659354"}], "key_name": "tempest-keypair-1318404474", "user_data": "}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:47.610449 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-62eef744-2dfb-4a52-9f6e-eace7f383488 req-b076787d-1088-4d1d-a564-1934fc6c4a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5a1195-56c1-4745-8903-f6bba84a4d19", "name": "network-vif-plugged", "status": "completed", "tag": "bf3b9deb-1402-409e-aeab-b183bf26a42e"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:47.623956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-62eef744-2dfb-4a52-9f6e-eace7f383488 req-b076787d-1088-4d1d-a564-1934fc6c4a83 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:47.624407 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-62eef744-2dfb-4a52-9f6e-eace7f383488 req-b076787d-1088-4d1d-a564-1934fc6c4a83 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:47.641718 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-62eef744-2dfb-4a52-9f6e-eace7f383488 req-b076787d-1088-4d1d-a564-1934fc6c4a83 service nova] Creating event network-vif-plugged:bf3b9deb-1402-409e-aeab-b183bf26a42e for instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 on hv-cinder-85014 Jul 18 08:48:47.651477 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-62eef744-2dfb-4a52-9f6e-eace7f383488 req-b076787d-1088-4d1d-a564-1934fc6c4a83 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044977 Jul 18 08:48:47.653459 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 146/315] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:48:47.677762 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-534f66fd-238d-4b3c-a6b3-b1acc12a3999 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:47.681836 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-534f66fd-238d-4b3c-a6b3-b1acc12a3999 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:47.690042 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-534f66fd-238d-4b3c-a6b3-b1acc12a3999 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:47.690510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-534f66fd-238d-4b3c-a6b3-b1acc12a3999 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:47.692581 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-534f66fd-238d-4b3c-a6b3-b1acc12a3999 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:47.693097 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-534f66fd-238d-4b3c-a6b3-b1acc12a3999 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:47.925135 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-534f66fd-238d-4b3c-a6b3-b1acc12a3999 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:47.959721 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-534f66fd-238d-4b3c-a6b3-b1acc12a3999 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:47.961250 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-534f66fd-238d-4b3c-a6b3-b1acc12a3999 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:47.962498 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-534f66fd-238d-4b3c-a6b3-b1acc12a3999 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.291026 Jul 18 08:48:47.964123 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 147/316] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:47 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:48.060408 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b844939a-e747-4cf3-95b4-a6ca7d9b0ef1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:48.061162 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b844939a-e747-4cf3-95b4-a6ca7d9b0ef1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:48.070080 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b844939a-e747-4cf3-95b4-a6ca7d9b0ef1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:48.070599 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b844939a-e747-4cf3-95b4-a6ca7d9b0ef1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:48.076016 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b844939a-e747-4cf3-95b4-a6ca7d9b0ef1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:48.076016 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b844939a-e747-4cf3-95b4-a6ca7d9b0ef1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:48.392411 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b844939a-e747-4cf3-95b4-a6ca7d9b0ef1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:48.408275 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b844939a-e747-4cf3-95b4-a6ca7d9b0ef1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1714 microversion: 2.1 time: 0.361622 Jul 18 08:48:48.410604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 148/317] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:48 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1714 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:48.417808 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3557588c-6504-4876-84ad-e66726cb509a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:48.425406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3557588c-6504-4876-84ad-e66726cb509a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:48.438161 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3557588c-6504-4876-84ad-e66726cb509a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:48.438907 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3557588c-6504-4876-84ad-e66726cb509a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:48.439860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3557588c-6504-4876-84ad-e66726cb509a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:48.440408 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3557588c-6504-4876-84ad-e66726cb509a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:48.684728 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3557588c-6504-4876-84ad-e66726cb509a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:48.698401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3557588c-6504-4876-84ad-e66726cb509a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1366 microversion: 2.1 time: 0.286468 Jul 18 08:48:48.699404 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 149/318] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:48 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:48.986495 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-55526aaf-ac49-4ec5-9dbd-1ee37ae20b07 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:48.987503 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-55526aaf-ac49-4ec5-9dbd-1ee37ae20b07 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:49.005308 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55526aaf-ac49-4ec5-9dbd-1ee37ae20b07 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:49.006104 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55526aaf-ac49-4ec5-9dbd-1ee37ae20b07 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:49.007223 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55526aaf-ac49-4ec5-9dbd-1ee37ae20b07 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:49.007774 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55526aaf-ac49-4ec5-9dbd-1ee37ae20b07 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:49.265903 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-55526aaf-ac49-4ec5-9dbd-1ee37ae20b07 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:49.283795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-55526aaf-ac49-4ec5-9dbd-1ee37ae20b07 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:49.285297 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-55526aaf-ac49-4ec5-9dbd-1ee37ae20b07 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:49.286670 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-55526aaf-ac49-4ec5-9dbd-1ee37ae20b07 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.307171 Jul 18 08:48:49.298610 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 150/319] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:48 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:49.720980 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-deb5956b-f249-4cfd-971f-dce9936a12c9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:49.721951 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-deb5956b-f249-4cfd-971f-dce9936a12c9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:49.741865 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-deb5956b-f249-4cfd-971f-dce9936a12c9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:49.745407 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-deb5956b-f249-4cfd-971f-dce9936a12c9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:49.745407 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-deb5956b-f249-4cfd-971f-dce9936a12c9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:49.745407 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-deb5956b-f249-4cfd-971f-dce9936a12c9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:49.890830 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.network.neutron [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] validate_networks() for [('7493bcf7-a4b9-4c49-a680-3a0a798b3b98', None, None, None, None, None)] {{(pid=124894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:48:50.001065 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-deb5956b-f249-4cfd-971f-dce9936a12c9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:50.037701 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-deb5956b-f249-4cfd-971f-dce9936a12c9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1366 microversion: 2.1 time: 0.324577 Jul 18 08:48:50.039159 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 151/320] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:49 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:50.306483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d507e775-eaee-4d11-b539-40bc9beebfa2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:50.307103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d507e775-eaee-4d11-b539-40bc9beebfa2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:50.314364 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d507e775-eaee-4d11-b539-40bc9beebfa2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:50.314822 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d507e775-eaee-4d11-b539-40bc9beebfa2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:50.320961 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d507e775-eaee-4d11-b539-40bc9beebfa2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:50.321493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d507e775-eaee-4d11-b539-40bc9beebfa2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:50.524961 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d507e775-eaee-4d11-b539-40bc9beebfa2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:50.534987 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d507e775-eaee-4d11-b539-40bc9beebfa2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:50.536642 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d507e775-eaee-4d11-b539-40bc9beebfa2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:50.537711 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d507e775-eaee-4d11-b539-40bc9beebfa2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.235408 Jul 18 08:48:50.538569 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 152/321] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:50 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:50.627736 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Flavor limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:48:50.628170 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Image limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:48:50.628646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Flavor pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:48:50.629051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Image pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:48:50.629458 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:48:50.640727 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:50.640727 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:50.641441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:50.641854 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:50.662222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Getting quotas for project c2f44b51cc624637bccd9ed1d3b1a769. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:48:50.667075 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Getting quotas for user 56b3d8d145d94b358c86345eb5c3b306 and project c2f44b51cc624637bccd9ed1d3b1a769. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:48:50.687572 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Going to run 1 instances... {{(pid=124894) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:48:50.690736 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:48:50.929189 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-cabac329-e625-4532-a8b3-ea209cb92b1f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.375308 Jul 18 08:48:50.929929 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 170/322] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:48:47 2022] POST /compute/v2.1/servers => generated 409 bytes in 3377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:48:50.943550 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-531cc570-b6e2-4447-8693-c62300b9e861 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:50.944753 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-531cc570-b6e2-4447-8693-c62300b9e861 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:51.018293 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-531cc570-b6e2-4447-8693-c62300b9e861 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:51.027107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-531cc570-b6e2-4447-8693-c62300b9e861 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1244 microversion: 2.1 time: 0.089993 Jul 18 08:48:51.028259 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 153/323] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:50 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:51.068533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-48f8ec52-46de-4803-8565-790cf31bb59f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:51.069599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-48f8ec52-46de-4803-8565-790cf31bb59f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:51.082303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48f8ec52-46de-4803-8565-790cf31bb59f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:51.083029 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48f8ec52-46de-4803-8565-790cf31bb59f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:51.084579 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48f8ec52-46de-4803-8565-790cf31bb59f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:51.085222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48f8ec52-46de-4803-8565-790cf31bb59f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:51.347135 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-48f8ec52-46de-4803-8565-790cf31bb59f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:51.357495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-48f8ec52-46de-4803-8565-790cf31bb59f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1557 microversion: 2.1 time: 0.296519 Jul 18 08:48:51.359251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 171/324] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:51 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1557 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:51.378039 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1d02b12d-a22c-4469-8852-95c22afc18ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:51.378870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1d02b12d-a22c-4469-8852-95c22afc18ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:51.389215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1d02b12d-a22c-4469-8852-95c22afc18ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:51.389690 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1d02b12d-a22c-4469-8852-95c22afc18ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:51.390480 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1d02b12d-a22c-4469-8852-95c22afc18ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:51.390979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1d02b12d-a22c-4469-8852-95c22afc18ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:51.508400 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1d02b12d-a22c-4469-8852-95c22afc18ab tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134168 Jul 18 08:48:51.509753 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 154/325] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 08:48:51 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:48:51.576656 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-371f72f0-b4f4-41c2-b4c9-8335ec71e6c9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:51.582057 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-371f72f0-b4f4-41c2-b4c9-8335ec71e6c9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:51.601798 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-371f72f0-b4f4-41c2-b4c9-8335ec71e6c9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:51.602369 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-371f72f0-b4f4-41c2-b4c9-8335ec71e6c9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:51.606866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-371f72f0-b4f4-41c2-b4c9-8335ec71e6c9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:51.607610 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-371f72f0-b4f4-41c2-b4c9-8335ec71e6c9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:52.058858 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-609bded8-3f37-46dd-a568-7010ab2dd557 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:52.058858 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-609bded8-3f37-46dd-a568-7010ab2dd557 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:52.108300 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-371f72f0-b4f4-41c2-b4c9-8335ec71e6c9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:52.122536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-371f72f0-b4f4-41c2-b4c9-8335ec71e6c9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:52.124326 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-371f72f0-b4f4-41c2-b4c9-8335ec71e6c9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:52.125546 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-371f72f0-b4f4-41c2-b4c9-8335ec71e6c9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.568268 Jul 18 08:48:52.140684 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 172/326] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:51 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:52.144158 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-609bded8-3f37-46dd-a568-7010ab2dd557 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:52.152097 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-609bded8-3f37-46dd-a568-7010ab2dd557 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1244 microversion: 2.1 time: 0.101117 Jul 18 08:48:52.156221 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 155/327] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:52 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:53.159404 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5395e553-3b1a-4835-b772-1c3026ebcc6a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:53.160691 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5395e553-3b1a-4835-b772-1c3026ebcc6a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:53.171115 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ca9e7843-5c1f-46da-b5f2-588c89d53b0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:53.171871 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ca9e7843-5c1f-46da-b5f2-588c89d53b0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:53.179774 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ca9e7843-5c1f-46da-b5f2-588c89d53b0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:53.183293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5395e553-3b1a-4835-b772-1c3026ebcc6a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:53.184269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5395e553-3b1a-4835-b772-1c3026ebcc6a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:53.186829 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5395e553-3b1a-4835-b772-1c3026ebcc6a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:53.187291 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5395e553-3b1a-4835-b772-1c3026ebcc6a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:53.190211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ca9e7843-5c1f-46da-b5f2-588c89d53b0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:53.193973 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ca9e7843-5c1f-46da-b5f2-588c89d53b0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:53.197449 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ca9e7843-5c1f-46da-b5f2-588c89d53b0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:53.390110 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ca9e7843-5c1f-46da-b5f2-588c89d53b0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:53.416043 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ca9e7843-5c1f-46da-b5f2-588c89d53b0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1240 microversion: 2.1 time: 0.249162 Jul 18 08:48:53.418472 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 156/328] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:53 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1240 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:48:53.658876 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5395e553-3b1a-4835-b772-1c3026ebcc6a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:53.668832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5395e553-3b1a-4835-b772-1c3026ebcc6a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:53.671265 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5395e553-3b1a-4835-b772-1c3026ebcc6a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:53.680976 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5395e553-3b1a-4835-b772-1c3026ebcc6a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.520930 Jul 18 08:48:53.681990 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 173/329] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:53 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:53.723102 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-b59e2330-0a9c-4932-9f2c-53529ed90282 req-b7e9d9e8-425f-4134-b17e-637e18ed23db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b5a1195-56c1-4745-8903-f6bba84a4d19", "tag": "bf3b9deb-1402-409e-aeab-b183bf26a42e"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:53.727999 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-b59e2330-0a9c-4932-9f2c-53529ed90282 req-b7e9d9e8-425f-4134-b17e-637e18ed23db service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:53.728918 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-b59e2330-0a9c-4932-9f2c-53529ed90282 req-b7e9d9e8-425f-4134-b17e-637e18ed23db service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:53.748243 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-b59e2330-0a9c-4932-9f2c-53529ed90282 req-b7e9d9e8-425f-4134-b17e-637e18ed23db service nova] Creating event network-changed:bf3b9deb-1402-409e-aeab-b183bf26a42e for instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 on hv-cinder-85014 Jul 18 08:48:53.755217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-b59e2330-0a9c-4932-9f2c-53529ed90282 req-b7e9d9e8-425f-4134-b17e-637e18ed23db service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055897 Jul 18 08:48:53.756632 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 157/330] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:48:54.437031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-214666b6-1e39-43a5-8f1f-0df35ff1a76b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:54.437896 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-214666b6-1e39-43a5-8f1f-0df35ff1a76b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:54.454972 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-214666b6-1e39-43a5-8f1f-0df35ff1a76b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:54.455443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-214666b6-1e39-43a5-8f1f-0df35ff1a76b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:54.456315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-214666b6-1e39-43a5-8f1f-0df35ff1a76b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:54.459865 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-214666b6-1e39-43a5-8f1f-0df35ff1a76b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:54.658811 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-214666b6-1e39-43a5-8f1f-0df35ff1a76b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:54.673862 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-214666b6-1e39-43a5-8f1f-0df35ff1a76b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1304 microversion: 2.1 time: 0.242092 Jul 18 08:48:54.674833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 174/331] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:54 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1304 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:54.731466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0701e4df-35e4-4725-92e5-724b06a4fcaa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:54.733803 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0701e4df-35e4-4725-92e5-724b06a4fcaa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:54.765952 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0701e4df-35e4-4725-92e5-724b06a4fcaa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:54.770355 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0701e4df-35e4-4725-92e5-724b06a4fcaa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:54.771949 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0701e4df-35e4-4725-92e5-724b06a4fcaa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:54.772511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0701e4df-35e4-4725-92e5-724b06a4fcaa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:55.192248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0701e4df-35e4-4725-92e5-724b06a4fcaa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:55.248891 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0701e4df-35e4-4725-92e5-724b06a4fcaa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:55.262982 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0701e4df-35e4-4725-92e5-724b06a4fcaa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:55.272393 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0701e4df-35e4-4725-92e5-724b06a4fcaa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.555825 Jul 18 08:48:55.274245 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 158/332] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:54 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:55.703656 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-29937c77-c1a8-4348-b951-5a80736a624f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:55.703656 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-29937c77-c1a8-4348-b951-5a80736a624f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:55.721327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-29937c77-c1a8-4348-b951-5a80736a624f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:55.722638 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-29937c77-c1a8-4348-b951-5a80736a624f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:55.726844 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-29937c77-c1a8-4348-b951-5a80736a624f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:55.727804 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-29937c77-c1a8-4348-b951-5a80736a624f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:55.858266 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-29937c77-c1a8-4348-b951-5a80736a624f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:55.866605 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-29937c77-c1a8-4348-b951-5a80736a624f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1302 microversion: 2.1 time: 0.177371 Jul 18 08:48:55.867194 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 175/333] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:55 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1302 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:56.295816 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-51a3c293-7a16-4bdb-aa76-84776bce4f8b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:56.296737 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-51a3c293-7a16-4bdb-aa76-84776bce4f8b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:56.303839 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-51a3c293-7a16-4bdb-aa76-84776bce4f8b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:56.304286 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-51a3c293-7a16-4bdb-aa76-84776bce4f8b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:56.305245 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-51a3c293-7a16-4bdb-aa76-84776bce4f8b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:56.305875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-51a3c293-7a16-4bdb-aa76-84776bce4f8b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:56.619913 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-51a3c293-7a16-4bdb-aa76-84776bce4f8b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:56.637516 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-51a3c293-7a16-4bdb-aa76-84776bce4f8b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:56.640105 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-51a3c293-7a16-4bdb-aa76-84776bce4f8b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:56.642554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-51a3c293-7a16-4bdb-aa76-84776bce4f8b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.350731 Jul 18 08:48:56.657411 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 159/334] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:56 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:56.885829 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-aff1c058-82e9-40d4-b567-cc9c4ef82a09 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:56.888124 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-aff1c058-82e9-40d4-b567-cc9c4ef82a09 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:56.897010 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aff1c058-82e9-40d4-b567-cc9c4ef82a09 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:56.897973 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aff1c058-82e9-40d4-b567-cc9c4ef82a09 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:56.914940 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aff1c058-82e9-40d4-b567-cc9c4ef82a09 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:56.915355 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aff1c058-82e9-40d4-b567-cc9c4ef82a09 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:57.233693 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-aff1c058-82e9-40d4-b567-cc9c4ef82a09 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:57.256921 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-aff1c058-82e9-40d4-b567-cc9c4ef82a09 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1370 microversion: 2.1 time: 0.373518 Jul 18 08:48:57.258050 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 176/335] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:56 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1370 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:57.663035 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6506b64e-441a-471b-bf15-40331b1ff87b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:57.664329 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-6506b64e-441a-471b-bf15-40331b1ff87b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:57.671369 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6506b64e-441a-471b-bf15-40331b1ff87b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:57.671876 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6506b64e-441a-471b-bf15-40331b1ff87b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:57.672948 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6506b64e-441a-471b-bf15-40331b1ff87b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:57.673390 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6506b64e-441a-471b-bf15-40331b1ff87b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:57.844879 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6506b64e-441a-471b-bf15-40331b1ff87b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:57.853675 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6506b64e-441a-471b-bf15-40331b1ff87b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:57.860612 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6506b64e-441a-471b-bf15-40331b1ff87b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:57.860612 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-6506b64e-441a-471b-bf15-40331b1ff87b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.197629 Jul 18 08:48:57.860612 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 160/336] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:57 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:48:58.281146 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b391df0b-4d0e-46c2-8386-0df00650ad99 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:58.281841 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b391df0b-4d0e-46c2-8386-0df00650ad99 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:58.291031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b391df0b-4d0e-46c2-8386-0df00650ad99 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:58.291422 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b391df0b-4d0e-46c2-8386-0df00650ad99 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:58.292258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b391df0b-4d0e-46c2-8386-0df00650ad99 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:58.294502 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b391df0b-4d0e-46c2-8386-0df00650ad99 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:58.545553 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b391df0b-4d0e-46c2-8386-0df00650ad99 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:58.555320 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b391df0b-4d0e-46c2-8386-0df00650ad99 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1370 microversion: 2.1 time: 0.278996 Jul 18 08:48:58.556276 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 177/337] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:58 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:48:58.648538 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-511d8f03-c37a-4b29-8854-de0e4c3cb0b5 req-b3eb10f3-6a63-4bf3-90c6-b588308c5ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d75586-3142-49ba-b48b-9db088664de7", "tag": "098eed33-e2bd-493f-826e-a819152c71b1"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:48:58.679024 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-511d8f03-c37a-4b29-8854-de0e4c3cb0b5 req-b3eb10f3-6a63-4bf3-90c6-b588308c5ebe service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:58.681599 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-511d8f03-c37a-4b29-8854-de0e4c3cb0b5 req-b3eb10f3-6a63-4bf3-90c6-b588308c5ebe service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:58.724597 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-511d8f03-c37a-4b29-8854-de0e4c3cb0b5 req-b3eb10f3-6a63-4bf3-90c6-b588308c5ebe service nova] Creating event network-changed:098eed33-e2bd-493f-826e-a819152c71b1 for instance f3d75586-3142-49ba-b48b-9db088664de7 on hv-cinder-85014 Jul 18 08:48:58.736871 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-511d8f03-c37a-4b29-8854-de0e4c3cb0b5 req-b3eb10f3-6a63-4bf3-90c6-b588308c5ebe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091875 Jul 18 08:48:58.738357 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 161/338] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:48:58.878083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-18fcfb95-1da5-44f3-b45a-3d3ae39f1de0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:58.878719 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-18fcfb95-1da5-44f3-b45a-3d3ae39f1de0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:58.897090 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-18fcfb95-1da5-44f3-b45a-3d3ae39f1de0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:58.897090 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-18fcfb95-1da5-44f3-b45a-3d3ae39f1de0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:58.897090 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-18fcfb95-1da5-44f3-b45a-3d3ae39f1de0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:58.897090 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-18fcfb95-1da5-44f3-b45a-3d3ae39f1de0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:59.188896 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-18fcfb95-1da5-44f3-b45a-3d3ae39f1de0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:59.200751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-18fcfb95-1da5-44f3-b45a-3d3ae39f1de0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:59.205381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-18fcfb95-1da5-44f3-b45a-3d3ae39f1de0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:48:59.207482 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-18fcfb95-1da5-44f3-b45a-3d3ae39f1de0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1739 microversion: 2.20 time: 0.335382 Jul 18 08:48:59.216028 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 178/339] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:48:58 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1739 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:48:59.597316 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-eb20a5dc-0956-44f6-b2c2-31c33afc8714 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:48:59.598929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-eb20a5dc-0956-44f6-b2c2-31c33afc8714 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:48:59.618627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eb20a5dc-0956-44f6-b2c2-31c33afc8714 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:59.622592 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eb20a5dc-0956-44f6-b2c2-31c33afc8714 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:48:59.632608 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eb20a5dc-0956-44f6-b2c2-31c33afc8714 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:48:59.632608 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eb20a5dc-0956-44f6-b2c2-31c33afc8714 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:00.046591 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-eb20a5dc-0956-44f6-b2c2-31c33afc8714 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:00.081998 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-eb20a5dc-0956-44f6-b2c2-31c33afc8714 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1370 microversion: 2.1 time: 0.512456 Jul 18 08:49:00.084854 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 162/340] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:48:59 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1370 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:00.250036 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9bdc48ec-32e4-4bcf-9c2c-e8024fae12ac tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:00.250556 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9bdc48ec-32e4-4bcf-9c2c-e8024fae12ac tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:00.259501 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9bdc48ec-32e4-4bcf-9c2c-e8024fae12ac tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:00.260072 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9bdc48ec-32e4-4bcf-9c2c-e8024fae12ac tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:00.261042 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9bdc48ec-32e4-4bcf-9c2c-e8024fae12ac tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:00.261725 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9bdc48ec-32e4-4bcf-9c2c-e8024fae12ac tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:00.427472 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9bdc48ec-32e4-4bcf-9c2c-e8024fae12ac tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:00.442901 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9bdc48ec-32e4-4bcf-9c2c-e8024fae12ac tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:00.445795 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9bdc48ec-32e4-4bcf-9c2c-e8024fae12ac tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:00.448064 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9bdc48ec-32e4-4bcf-9c2c-e8024fae12ac tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1721 microversion: 2.20 time: 0.220978 Jul 18 08:49:00.449602 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 179/341] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:00 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:01.116234 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d175b346-a9f7-4420-9c16-a6031f487d82 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:01.117442 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d175b346-a9f7-4420-9c16-a6031f487d82 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:01.128240 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d175b346-a9f7-4420-9c16-a6031f487d82 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:01.134796 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d175b346-a9f7-4420-9c16-a6031f487d82 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:01.135901 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d175b346-a9f7-4420-9c16-a6031f487d82 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:01.136578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d175b346-a9f7-4420-9c16-a6031f487d82 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:01.351570 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-e5e025e3-e6eb-4964-981b-1a6f89f4f369 req-cc3b0934-b1ac-4f2e-b0f2-92be49c413ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d6245b-0c6d-4a19-85c6-841d85912f2e", "name": "network-vif-unplugged", "status": "completed", "tag": "222385f0-b84b-466b-a9f5-dab4e9dadd74"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:01.364071 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:01.367791 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=6 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:01.383923 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-e5e025e3-e6eb-4964-981b-1a6f89f4f369 req-cc3b0934-b1ac-4f2e-b0f2-92be49c413ec service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:01.384587 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-e5e025e3-e6eb-4964-981b-1a6f89f4f369 req-cc3b0934-b1ac-4f2e-b0f2-92be49c413ec service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:01.406154 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-e5e025e3-e6eb-4964-981b-1a6f89f4f369 req-cc3b0934-b1ac-4f2e-b0f2-92be49c413ec service nova] Creating event network-vif-unplugged:222385f0-b84b-466b-a9f5-dab4e9dadd74 for instance f3d6245b-0c6d-4a19-85c6-841d85912f2e on hv-cinder-85014 Jul 18 08:49:01.406154 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-e5e025e3-e6eb-4964-981b-1a6f89f4f369 req-cc3b0934-b1ac-4f2e-b0f2-92be49c413ec service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058225 Jul 18 08:49:01.407398 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 180/342] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:01.469919 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-140d732b-24ac-4449-8453-90821d6108c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:01.471257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-140d732b-24ac-4449-8453-90821d6108c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:01.482127 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-140d732b-24ac-4449-8453-90821d6108c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:01.482127 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-140d732b-24ac-4449-8453-90821d6108c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:01.482127 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-140d732b-24ac-4449-8453-90821d6108c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:01.482863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-140d732b-24ac-4449-8453-90821d6108c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:01.669832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d175b346-a9f7-4420-9c16-a6031f487d82 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:01.682843 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d175b346-a9f7-4420-9c16-a6031f487d82 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1370 microversion: 2.1 time: 0.571052 Jul 18 08:49:01.684484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 163/343] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:01 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1370 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:01.793034 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-140d732b-24ac-4449-8453-90821d6108c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:01.802629 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-140d732b-24ac-4449-8453-90821d6108c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:01.804327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-140d732b-24ac-4449-8453-90821d6108c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:01.806110 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-140d732b-24ac-4449-8453-90821d6108c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1721 microversion: 2.20 time: 0.341077 Jul 18 08:49:01.806556 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 181/344] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:01 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1721 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:49:02.705049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d9ef39ac-75f7-43fe-b3fb-90a146fd4bfd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:02.705693 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d9ef39ac-75f7-43fe-b3fb-90a146fd4bfd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:02.712028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=8 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:02.714646 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d9ef39ac-75f7-43fe-b3fb-90a146fd4bfd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:02.715385 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d9ef39ac-75f7-43fe-b3fb-90a146fd4bfd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:02.716382 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d9ef39ac-75f7-43fe-b3fb-90a146fd4bfd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:02.716831 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d9ef39ac-75f7-43fe-b3fb-90a146fd4bfd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:02.834119 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5cea4b15-f012-4dc9-89ef-9140b58c5b45 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:02.836262 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5cea4b15-f012-4dc9-89ef-9140b58c5b45 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:02.847842 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5cea4b15-f012-4dc9-89ef-9140b58c5b45 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:02.852035 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5cea4b15-f012-4dc9-89ef-9140b58c5b45 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:02.852035 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5cea4b15-f012-4dc9-89ef-9140b58c5b45 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:02.853436 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5cea4b15-f012-4dc9-89ef-9140b58c5b45 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:02.942522 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d9ef39ac-75f7-43fe-b3fb-90a146fd4bfd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:02.944853 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=100 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:02.955564 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d9ef39ac-75f7-43fe-b3fb-90a146fd4bfd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1370 microversion: 2.1 time: 0.255036 Jul 18 08:49:02.956707 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 164/345] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:02 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1370 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:03.375307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5cea4b15-f012-4dc9-89ef-9140b58c5b45 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:03.386309 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5cea4b15-f012-4dc9-89ef-9140b58c5b45 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:03.398317 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5cea4b15-f012-4dc9-89ef-9140b58c5b45 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:03.398317 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5cea4b15-f012-4dc9-89ef-9140b58c5b45 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1721 microversion: 2.20 time: 0.571621 Jul 18 08:49:03.398317 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 182/346] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:02 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1721 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:03.974251 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2f9b2e9a-a58b-471e-b317-4d671b471901 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:03.975089 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2f9b2e9a-a58b-471e-b317-4d671b471901 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:03.982973 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f9b2e9a-a58b-471e-b317-4d671b471901 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:03.983428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f9b2e9a-a58b-471e-b317-4d671b471901 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:03.984352 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f9b2e9a-a58b-471e-b317-4d671b471901 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:03.984889 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f9b2e9a-a58b-471e-b317-4d671b471901 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:04.202371 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2f9b2e9a-a58b-471e-b317-4d671b471901 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:04.211343 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2f9b2e9a-a58b-471e-b317-4d671b471901 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1370 microversion: 2.1 time: 0.241629 Jul 18 08:49:04.212459 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 165/347] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:03 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:04.412411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b014d137-7c83-46c8-951b-eae2beea21bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:04.413340 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b014d137-7c83-46c8-951b-eae2beea21bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:04.421386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b014d137-7c83-46c8-951b-eae2beea21bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:04.422270 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b014d137-7c83-46c8-951b-eae2beea21bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:04.423359 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b014d137-7c83-46c8-951b-eae2beea21bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:04.424707 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b014d137-7c83-46c8-951b-eae2beea21bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:04.812401 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b014d137-7c83-46c8-951b-eae2beea21bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:04.845157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b014d137-7c83-46c8-951b-eae2beea21bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:04.855350 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b014d137-7c83-46c8-951b-eae2beea21bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:04.867192 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b014d137-7c83-46c8-951b-eae2beea21bb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1724 microversion: 2.20 time: 0.448042 Jul 18 08:49:04.887786 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 183/348] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:04 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1724 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:04.895491 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-fd41f338-9b8f-4107-b0fc-20363eaf2dc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecd8b240-c6bc-4461-b14f-8f55ca94cb83"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:04.898034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-fd41f338-9b8f-4107-b0fc-20363eaf2dc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:04.911097 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd41f338-9b8f-4107-b0fc-20363eaf2dc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:04.913270 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd41f338-9b8f-4107-b0fc-20363eaf2dc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:04.916232 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd41f338-9b8f-4107-b0fc-20363eaf2dc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:04.918047 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd41f338-9b8f-4107-b0fc-20363eaf2dc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:05.229294 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-44be284f-9226-4729-b1f4-6fb9ecb89141 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:05.230869 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-44be284f-9226-4729-b1f4-6fb9ecb89141 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:05.240769 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-44be284f-9226-4729-b1f4-6fb9ecb89141 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:05.241467 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-44be284f-9226-4729-b1f4-6fb9ecb89141 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:05.242567 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-44be284f-9226-4729-b1f4-6fb9ecb89141 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:05.243182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-44be284f-9226-4729-b1f4-6fb9ecb89141 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:05.504101 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-44be284f-9226-4729-b1f4-6fb9ecb89141 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:05.516477 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-44be284f-9226-4729-b1f4-6fb9ecb89141 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1370 microversion: 2.1 time: 0.291423 Jul 18 08:49:05.517044 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 184/349] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:05 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:06.524419 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-fd41f338-9b8f-4107-b0fc-20363eaf2dc1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "POST /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.634689 Jul 18 08:49:06.525373 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 166/350] 10.222.0.57 () {62 vars in 1363 bytes} [Mon Jul 18 08:49:04 2022] POST /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments => generated 188 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 08:49:06.533330 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-97f59135-9310-4506-9915-842cbf56ed8c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:06.534694 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-97f59135-9310-4506-9915-842cbf56ed8c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:06.542267 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-97f59135-9310-4506-9915-842cbf56ed8c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:06.543492 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-97f59135-9310-4506-9915-842cbf56ed8c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:06.544357 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-97f59135-9310-4506-9915-842cbf56ed8c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:06.544803 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-97f59135-9310-4506-9915-842cbf56ed8c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:06.722717 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e46169c2-469b-42a9-adf5-8c50cdea8a55 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:06.723383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e46169c2-469b-42a9-adf5-8c50cdea8a55 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:06.741992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e46169c2-469b-42a9-adf5-8c50cdea8a55 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:06.742566 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e46169c2-469b-42a9-adf5-8c50cdea8a55 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:06.744463 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e46169c2-469b-42a9-adf5-8c50cdea8a55 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:06.746539 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e46169c2-469b-42a9-adf5-8c50cdea8a55 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:06.960563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-97f59135-9310-4506-9915-842cbf56ed8c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:06.976529 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-97f59135-9310-4506-9915-842cbf56ed8c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1370 microversion: 2.1 time: 0.447023 Jul 18 08:49:06.977129 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 185/351] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:06 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1370 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:07.185388 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e46169c2-469b-42a9-adf5-8c50cdea8a55 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "POST /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/action" status: 202 len: 0 microversion: 2.20 time: 0.466566 Jul 18 08:49:07.192057 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 167/352] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 08:49:06 2022] POST /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 08:49:07.199072 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2954bfcb-7b0a-4f68-bd46-375591dfce95 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:07.201551 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-2954bfcb-7b0a-4f68-bd46-375591dfce95 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:07.215805 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2954bfcb-7b0a-4f68-bd46-375591dfce95 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:07.216993 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2954bfcb-7b0a-4f68-bd46-375591dfce95 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:07.218130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2954bfcb-7b0a-4f68-bd46-375591dfce95 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:07.218953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2954bfcb-7b0a-4f68-bd46-375591dfce95 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:07.423939 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2954bfcb-7b0a-4f68-bd46-375591dfce95 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:07.446704 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2954bfcb-7b0a-4f68-bd46-375591dfce95 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:07.446704 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2954bfcb-7b0a-4f68-bd46-375591dfce95 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:07.450468 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2954bfcb-7b0a-4f68-bd46-375591dfce95 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1750 microversion: 2.20 time: 0.259571 Jul 18 08:49:07.451096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 186/353] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:07 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1750 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:49:07.948199 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-c809e0b1-3cb7-441d-9535-1538ba304c4f req-d48b8d1c-4bdd-40bd-b81d-56196830b60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d75586-3142-49ba-b48b-9db088664de7", "name": "network-vif-plugged", "status": "completed", "tag": "098eed33-e2bd-493f-826e-a819152c71b1"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:07.958042 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-c809e0b1-3cb7-441d-9535-1538ba304c4f req-d48b8d1c-4bdd-40bd-b81d-56196830b60c service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:07.958486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-c809e0b1-3cb7-441d-9535-1538ba304c4f req-d48b8d1c-4bdd-40bd-b81d-56196830b60c service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:07.973626 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-c809e0b1-3cb7-441d-9535-1538ba304c4f req-d48b8d1c-4bdd-40bd-b81d-56196830b60c service nova] Creating event network-vif-plugged:098eed33-e2bd-493f-826e-a819152c71b1 for instance f3d75586-3142-49ba-b48b-9db088664de7 on hv-cinder-85014 Jul 18 08:49:07.981241 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-c809e0b1-3cb7-441d-9535-1538ba304c4f req-d48b8d1c-4bdd-40bd-b81d-56196830b60c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037322 Jul 18 08:49:07.985182 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 168/354] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:08.001728 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c98dc68f-8549-4799-a5e5-f2ce501eb747 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:08.005923 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c98dc68f-8549-4799-a5e5-f2ce501eb747 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:08.021103 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c98dc68f-8549-4799-a5e5-f2ce501eb747 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:08.021887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c98dc68f-8549-4799-a5e5-f2ce501eb747 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:08.023851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c98dc68f-8549-4799-a5e5-f2ce501eb747 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:08.024528 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c98dc68f-8549-4799-a5e5-f2ce501eb747 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:08.264876 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c98dc68f-8549-4799-a5e5-f2ce501eb747 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:08.267274 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=100 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:08.281268 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c98dc68f-8549-4799-a5e5-f2ce501eb747 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1370 microversion: 2.1 time: 0.281792 Jul 18 08:49:08.290122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 187/355] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:07 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1370 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:08.473719 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b0c9fe6d-f5e5-4c20-99a0-ddd38bf876f0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:08.474753 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b0c9fe6d-f5e5-4c20-99a0-ddd38bf876f0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:08.484008 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b0c9fe6d-f5e5-4c20-99a0-ddd38bf876f0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:08.489925 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b0c9fe6d-f5e5-4c20-99a0-ddd38bf876f0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:08.489925 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b0c9fe6d-f5e5-4c20-99a0-ddd38bf876f0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:08.489925 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b0c9fe6d-f5e5-4c20-99a0-ddd38bf876f0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:08.796097 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b0c9fe6d-f5e5-4c20-99a0-ddd38bf876f0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:08.805152 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b0c9fe6d-f5e5-4c20-99a0-ddd38bf876f0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:08.806684 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b0c9fe6d-f5e5-4c20-99a0-ddd38bf876f0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:08.809586 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b0c9fe6d-f5e5-4c20-99a0-ddd38bf876f0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1750 microversion: 2.20 time: 0.340834 Jul 18 08:49:08.810693 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 169/356] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:08 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1750 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:09.304360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8c858bd6-1825-4c75-8b1e-252716dd720f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:09.311137 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8c858bd6-1825-4c75-8b1e-252716dd720f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:09.350133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8c858bd6-1825-4c75-8b1e-252716dd720f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:09.350756 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8c858bd6-1825-4c75-8b1e-252716dd720f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:09.352138 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8c858bd6-1825-4c75-8b1e-252716dd720f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:09.357361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8c858bd6-1825-4c75-8b1e-252716dd720f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:09.632081 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8c858bd6-1825-4c75-8b1e-252716dd720f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:09.640769 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8c858bd6-1825-4c75-8b1e-252716dd720f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1370 microversion: 2.1 time: 0.344782 Jul 18 08:49:09.650314 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 188/357] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:09 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1370 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:09.831583 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b4dda2c2-7a30-43ab-9f87-9f24ee5685a0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:09.833283 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b4dda2c2-7a30-43ab-9f87-9f24ee5685a0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:09.845474 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b4dda2c2-7a30-43ab-9f87-9f24ee5685a0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:09.846210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b4dda2c2-7a30-43ab-9f87-9f24ee5685a0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:09.847540 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b4dda2c2-7a30-43ab-9f87-9f24ee5685a0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:09.849909 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b4dda2c2-7a30-43ab-9f87-9f24ee5685a0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:10.049202 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b4dda2c2-7a30-43ab-9f87-9f24ee5685a0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:10.060352 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b4dda2c2-7a30-43ab-9f87-9f24ee5685a0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:10.062421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b4dda2c2-7a30-43ab-9f87-9f24ee5685a0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:10.064067 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b4dda2c2-7a30-43ab-9f87-9f24ee5685a0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1750 microversion: 2.20 time: 0.236671 Jul 18 08:49:10.064938 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 170/358] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:09 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1750 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:10.676712 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-45137e47-7889-4b8d-9c3b-7c6cfe9031bc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:10.682629 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-45137e47-7889-4b8d-9c3b-7c6cfe9031bc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:10.750824 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-45137e47-7889-4b8d-9c3b-7c6cfe9031bc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:10.751084 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-45137e47-7889-4b8d-9c3b-7c6cfe9031bc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:10.753733 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-45137e47-7889-4b8d-9c3b-7c6cfe9031bc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:10.754410 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-45137e47-7889-4b8d-9c3b-7c6cfe9031bc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:11.015959 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-45137e47-7889-4b8d-9c3b-7c6cfe9031bc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:11.028106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-45137e47-7889-4b8d-9c3b-7c6cfe9031bc tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1563 microversion: 2.1 time: 0.370924 Jul 18 08:49:11.028961 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 189/359] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:10 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1563 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:11.046097 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-32ff6929-0dea-4962-809b-5f623ab209fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:11.046656 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-32ff6929-0dea-4962-809b-5f623ab209fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:11.054477 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-32ff6929-0dea-4962-809b-5f623ab209fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:11.054939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-32ff6929-0dea-4962-809b-5f623ab209fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:11.055757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-32ff6929-0dea-4962-809b-5f623ab209fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:11.056239 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-32ff6929-0dea-4962-809b-5f623ab209fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:11.085092 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a3cfe1dc-bf8c-44ae-9734-33e7eb2e42c2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:11.085916 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a3cfe1dc-bf8c-44ae-9734-33e7eb2e42c2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:11.093136 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3cfe1dc-bf8c-44ae-9734-33e7eb2e42c2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:11.093739 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3cfe1dc-bf8c-44ae-9734-33e7eb2e42c2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:11.094712 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3cfe1dc-bf8c-44ae-9734-33e7eb2e42c2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:11.094978 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3cfe1dc-bf8c-44ae-9734-33e7eb2e42c2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:11.229183 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-32ff6929-0dea-4962-809b-5f623ab209fd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187868 Jul 18 08:49:11.230498 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 171/360] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 08:49:11 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:11.281149 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a3cfe1dc-bf8c-44ae-9734-33e7eb2e42c2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:11.293144 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a3cfe1dc-bf8c-44ae-9734-33e7eb2e42c2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:11.294863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a3cfe1dc-bf8c-44ae-9734-33e7eb2e42c2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:11.296146 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a3cfe1dc-bf8c-44ae-9734-33e7eb2e42c2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1752 microversion: 2.20 time: 0.216310 Jul 18 08:49:11.296699 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 190/361] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:11 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:12.319855 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-441ec45b-adc5-44f7-9531-0bf35be23517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:12.322332 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-441ec45b-adc5-44f7-9531-0bf35be23517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:12.331884 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-441ec45b-adc5-44f7-9531-0bf35be23517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:12.331884 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-441ec45b-adc5-44f7-9531-0bf35be23517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:12.331884 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-441ec45b-adc5-44f7-9531-0bf35be23517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:12.333045 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-441ec45b-adc5-44f7-9531-0bf35be23517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:12.845048 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-441ec45b-adc5-44f7-9531-0bf35be23517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:12.863685 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-441ec45b-adc5-44f7-9531-0bf35be23517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:12.865882 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-441ec45b-adc5-44f7-9531-0bf35be23517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:12.867125 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-441ec45b-adc5-44f7-9531-0bf35be23517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1752 microversion: 2.20 time: 0.556242 Jul 18 08:49:12.879197 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 172/362] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:12 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1752 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:13.887446 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-dccee984-a401-4444-8880-3d8558e58c2d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:13.888946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-dccee984-a401-4444-8880-3d8558e58c2d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:13.890373 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-b8abfe2c-4c0e-473a-bd46-ad404a700e0b req-9f8a7dfe-e429-4263-ba09-928eea5abb1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d75586-3142-49ba-b48b-9db088664de7", "tag": "098eed33-e2bd-493f-826e-a819152c71b1"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:13.896744 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:13.898616 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dccee984-a401-4444-8880-3d8558e58c2d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:13.899327 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dccee984-a401-4444-8880-3d8558e58c2d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:13.900465 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dccee984-a401-4444-8880-3d8558e58c2d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:13.901462 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dccee984-a401-4444-8880-3d8558e58c2d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:13.905931 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:13.918832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-b8abfe2c-4c0e-473a-bd46-ad404a700e0b req-9f8a7dfe-e429-4263-ba09-928eea5abb1b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:13.920599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-b8abfe2c-4c0e-473a-bd46-ad404a700e0b req-9f8a7dfe-e429-4263-ba09-928eea5abb1b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:13.943839 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-b8abfe2c-4c0e-473a-bd46-ad404a700e0b req-9f8a7dfe-e429-4263-ba09-928eea5abb1b service nova] Creating event network-changed:098eed33-e2bd-493f-826e-a819152c71b1 for instance f3d75586-3142-49ba-b48b-9db088664de7 on hv-cinder-85014 Jul 18 08:49:13.953976 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-b8abfe2c-4c0e-473a-bd46-ad404a700e0b req-9f8a7dfe-e429-4263-ba09-928eea5abb1b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079579 Jul 18 08:49:13.955024 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 191/363] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:49:14.168414 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-dccee984-a401-4444-8880-3d8558e58c2d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:14.179931 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-dccee984-a401-4444-8880-3d8558e58c2d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:14.183810 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-dccee984-a401-4444-8880-3d8558e58c2d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:14.186262 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-dccee984-a401-4444-8880-3d8558e58c2d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.303231 Jul 18 08:49:14.187415 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 173/364] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:13 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:15.209629 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b7a7eeca-2806-48cb-b221-b68c53901640 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:15.210942 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b7a7eeca-2806-48cb-b221-b68c53901640 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:15.219472 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b7a7eeca-2806-48cb-b221-b68c53901640 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:15.220127 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b7a7eeca-2806-48cb-b221-b68c53901640 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:15.223121 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b7a7eeca-2806-48cb-b221-b68c53901640 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:15.223121 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b7a7eeca-2806-48cb-b221-b68c53901640 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:15.469887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b7a7eeca-2806-48cb-b221-b68c53901640 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:15.481111 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b7a7eeca-2806-48cb-b221-b68c53901640 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:15.483070 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b7a7eeca-2806-48cb-b221-b68c53901640 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:15.484763 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b7a7eeca-2806-48cb-b221-b68c53901640 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.280139 Jul 18 08:49:15.486160 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 192/365] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:15 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:16.507735 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-505c6810-2c9b-4e2c-a8ff-5831a0f9ca5e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:16.509252 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-505c6810-2c9b-4e2c-a8ff-5831a0f9ca5e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:16.516137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-505c6810-2c9b-4e2c-a8ff-5831a0f9ca5e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:16.520222 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-505c6810-2c9b-4e2c-a8ff-5831a0f9ca5e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:16.520222 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-505c6810-2c9b-4e2c-a8ff-5831a0f9ca5e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:16.520222 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-505c6810-2c9b-4e2c-a8ff-5831a0f9ca5e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:16.696088 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-505c6810-2c9b-4e2c-a8ff-5831a0f9ca5e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:16.716764 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-505c6810-2c9b-4e2c-a8ff-5831a0f9ca5e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:16.716764 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-505c6810-2c9b-4e2c-a8ff-5831a0f9ca5e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:16.716764 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-505c6810-2c9b-4e2c-a8ff-5831a0f9ca5e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.210797 Jul 18 08:49:16.717441 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 174/366] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:16 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:17.735465 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-738c2ed5-61cc-41b7-8946-c8364a2306a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:17.736340 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-738c2ed5-61cc-41b7-8946-c8364a2306a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:17.749596 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-738c2ed5-61cc-41b7-8946-c8364a2306a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:17.750255 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-738c2ed5-61cc-41b7-8946-c8364a2306a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:17.751786 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-738c2ed5-61cc-41b7-8946-c8364a2306a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:17.752679 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-738c2ed5-61cc-41b7-8946-c8364a2306a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:18.043506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-738c2ed5-61cc-41b7-8946-c8364a2306a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:18.052924 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-738c2ed5-61cc-41b7-8946-c8364a2306a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:18.055150 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-738c2ed5-61cc-41b7-8946-c8364a2306a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:18.056792 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-738c2ed5-61cc-41b7-8946-c8364a2306a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.326757 Jul 18 08:49:18.057472 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 193/367] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:17 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:19.103332 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2b368438-8f3b-4b08-853c-9d522f95f204 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:19.105485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2b368438-8f3b-4b08-853c-9d522f95f204 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:19.128306 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2b368438-8f3b-4b08-853c-9d522f95f204 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:19.129433 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2b368438-8f3b-4b08-853c-9d522f95f204 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:19.130804 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2b368438-8f3b-4b08-853c-9d522f95f204 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:19.135795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2b368438-8f3b-4b08-853c-9d522f95f204 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:19.407979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2b368438-8f3b-4b08-853c-9d522f95f204 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:19.422426 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2b368438-8f3b-4b08-853c-9d522f95f204 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:19.428576 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2b368438-8f3b-4b08-853c-9d522f95f204 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:19.431770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2b368438-8f3b-4b08-853c-9d522f95f204 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.351314 Jul 18 08:49:19.438093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 175/368] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:19 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:20.456852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8ae4527e-31ae-4d97-b669-d4f693672358 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:20.460883 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8ae4527e-31ae-4d97-b669-d4f693672358 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:20.479816 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8ae4527e-31ae-4d97-b669-d4f693672358 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:20.480780 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8ae4527e-31ae-4d97-b669-d4f693672358 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:20.484820 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8ae4527e-31ae-4d97-b669-d4f693672358 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:20.485888 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8ae4527e-31ae-4d97-b669-d4f693672358 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:20.849042 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8ae4527e-31ae-4d97-b669-d4f693672358 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:20.868147 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8ae4527e-31ae-4d97-b669-d4f693672358 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:20.875251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8ae4527e-31ae-4d97-b669-d4f693672358 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:20.879874 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8ae4527e-31ae-4d97-b669-d4f693672358 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.427214 Jul 18 08:49:20.884065 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 194/369] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:20 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:21.900904 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5ca50481-3dfa-4fae-9bfc-f770309e85f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:21.901690 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5ca50481-3dfa-4fae-9bfc-f770309e85f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:21.926759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5ca50481-3dfa-4fae-9bfc-f770309e85f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:21.927401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5ca50481-3dfa-4fae-9bfc-f770309e85f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:21.936146 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5ca50481-3dfa-4fae-9bfc-f770309e85f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:21.938421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5ca50481-3dfa-4fae-9bfc-f770309e85f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:22.420519 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5ca50481-3dfa-4fae-9bfc-f770309e85f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:22.443218 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5ca50481-3dfa-4fae-9bfc-f770309e85f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:22.459132 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5ca50481-3dfa-4fae-9bfc-f770309e85f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:22.461632 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5ca50481-3dfa-4fae-9bfc-f770309e85f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.564615 Jul 18 08:49:22.462775 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 176/370] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:21 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:23.483696 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f546a05a-5782-4df7-aad0-0a51820dc3f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:23.484536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f546a05a-5782-4df7-aad0-0a51820dc3f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:23.498387 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f546a05a-5782-4df7-aad0-0a51820dc3f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:23.498802 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f546a05a-5782-4df7-aad0-0a51820dc3f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:23.499822 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f546a05a-5782-4df7-aad0-0a51820dc3f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:23.500526 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f546a05a-5782-4df7-aad0-0a51820dc3f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:23.936592 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f546a05a-5782-4df7-aad0-0a51820dc3f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:23.984784 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f546a05a-5782-4df7-aad0-0a51820dc3f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:24.018069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f546a05a-5782-4df7-aad0-0a51820dc3f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:24.019998 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f546a05a-5782-4df7-aad0-0a51820dc3f8 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.541392 Jul 18 08:49:24.020779 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 195/371] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:23 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:25.038785 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c22f5f5c-21bd-4455-b7d0-779180978495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:25.039483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c22f5f5c-21bd-4455-b7d0-779180978495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:25.047036 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c22f5f5c-21bd-4455-b7d0-779180978495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:25.056269 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c22f5f5c-21bd-4455-b7d0-779180978495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:25.057332 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c22f5f5c-21bd-4455-b7d0-779180978495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:25.062836 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c22f5f5c-21bd-4455-b7d0-779180978495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:25.381289 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c22f5f5c-21bd-4455-b7d0-779180978495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:25.401058 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c22f5f5c-21bd-4455-b7d0-779180978495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:25.404852 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c22f5f5c-21bd-4455-b7d0-779180978495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:25.406785 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c22f5f5c-21bd-4455-b7d0-779180978495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.372236 Jul 18 08:49:25.408081 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 177/372] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:25 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:26.441364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ccd77941-8fd9-48f2-bd69-a6b5ffccfc54 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:26.442981 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ccd77941-8fd9-48f2-bd69-a6b5ffccfc54 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:26.458573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ccd77941-8fd9-48f2-bd69-a6b5ffccfc54 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:26.463096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ccd77941-8fd9-48f2-bd69-a6b5ffccfc54 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:26.463096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ccd77941-8fd9-48f2-bd69-a6b5ffccfc54 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:26.463096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ccd77941-8fd9-48f2-bd69-a6b5ffccfc54 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:26.741557 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ccd77941-8fd9-48f2-bd69-a6b5ffccfc54 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:26.758120 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ccd77941-8fd9-48f2-bd69-a6b5ffccfc54 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:26.763399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ccd77941-8fd9-48f2-bd69-a6b5ffccfc54 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:26.766085 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ccd77941-8fd9-48f2-bd69-a6b5ffccfc54 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.329253 Jul 18 08:49:26.766702 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 196/373] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:26 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:27.787801 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-842833e3-acf5-4877-a199-d4a4a2880a61 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:27.792624 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-842833e3-acf5-4877-a199-d4a4a2880a61 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:27.795048 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-842833e3-acf5-4877-a199-d4a4a2880a61 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:27.795497 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-842833e3-acf5-4877-a199-d4a4a2880a61 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:27.796331 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-842833e3-acf5-4877-a199-d4a4a2880a61 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:27.796731 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-842833e3-acf5-4877-a199-d4a4a2880a61 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:27.956740 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-842833e3-acf5-4877-a199-d4a4a2880a61 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:27.964148 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:27.971303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-842833e3-acf5-4877-a199-d4a4a2880a61 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:27.973549 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-842833e3-acf5-4877-a199-d4a4a2880a61 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:27.974079 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-842833e3-acf5-4877-a199-d4a4a2880a61 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.190317 Jul 18 08:49:27.974646 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 178/374] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:27 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:28.994550 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1dce129b-0366-4955-b5c5-ce118a61a56e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:28.996552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1dce129b-0366-4955-b5c5-ce118a61a56e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:29.008552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1dce129b-0366-4955-b5c5-ce118a61a56e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:29.009261 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1dce129b-0366-4955-b5c5-ce118a61a56e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:29.012880 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1dce129b-0366-4955-b5c5-ce118a61a56e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:29.013551 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1dce129b-0366-4955-b5c5-ce118a61a56e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:29.322632 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1dce129b-0366-4955-b5c5-ce118a61a56e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:29.335864 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1dce129b-0366-4955-b5c5-ce118a61a56e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:29.341815 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1dce129b-0366-4955-b5c5-ce118a61a56e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:29.353204 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1dce129b-0366-4955-b5c5-ce118a61a56e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.362424 Jul 18 08:49:29.354091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 197/375] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:28 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:49:30.378309 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-867debbc-0957-4a5a-8765-94b34f2a0072 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:30.379538 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-867debbc-0957-4a5a-8765-94b34f2a0072 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:30.410015 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-867debbc-0957-4a5a-8765-94b34f2a0072 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:30.410576 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-867debbc-0957-4a5a-8765-94b34f2a0072 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:30.411425 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-867debbc-0957-4a5a-8765-94b34f2a0072 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:30.411959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-867debbc-0957-4a5a-8765-94b34f2a0072 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:31.008587 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-867debbc-0957-4a5a-8765-94b34f2a0072 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:31.048486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-867debbc-0957-4a5a-8765-94b34f2a0072 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:31.065995 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-867debbc-0957-4a5a-8765-94b34f2a0072 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:31.077533 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-867debbc-0957-4a5a-8765-94b34f2a0072 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.705481 Jul 18 08:49:31.083348 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 179/376] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:30 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:31.264003 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-910c78f3-ae4a-4306-ae10-f8698d163722 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:31.265327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-910c78f3-ae4a-4306-ae10-f8698d163722 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:31.279788 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-910c78f3-ae4a-4306-ae10-f8698d163722 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:31.280568 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-910c78f3-ae4a-4306-ae10-f8698d163722 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:31.281618 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-910c78f3-ae4a-4306-ae10-f8698d163722 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:31.282371 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-910c78f3-ae4a-4306-ae10-f8698d163722 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:31.592290 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-910c78f3-ae4a-4306-ae10-f8698d163722 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lazy-loading 'services' on Instance uuid fcda6e64-2c95-4eb7-bff6-6e13f99e254e {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:49:32.104881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5874100f-9c76-4913-9bfb-9bbfe44e4170 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:32.104881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5874100f-9c76-4913-9bfb-9bbfe44e4170 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:32.110738 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5874100f-9c76-4913-9bfb-9bbfe44e4170 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:32.111313 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5874100f-9c76-4913-9bfb-9bbfe44e4170 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:32.112121 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5874100f-9c76-4913-9bfb-9bbfe44e4170 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:32.112563 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5874100f-9c76-4913-9bfb-9bbfe44e4170 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:32.266699 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5874100f-9c76-4913-9bfb-9bbfe44e4170 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:32.277917 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5874100f-9c76-4913-9bfb-9bbfe44e4170 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:32.279426 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5874100f-9c76-4913-9bfb-9bbfe44e4170 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:32.280605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5874100f-9c76-4913-9bfb-9bbfe44e4170 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.182027 Jul 18 08:49:32.281153 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 180/377] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:32 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:32.699065 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-910c78f3-ae4a-4306-ae10-f8698d163722 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/os-volume_attachments/3ee49f62-9eaf-47dd-a582-b4b8daea0984" status: 202 len: 0 microversion: 2.1 time: 1.444417 Jul 18 08:49:32.700445 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 198/378] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:49:31 2022] DELETE /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/os-volume_attachments/3ee49f62-9eaf-47dd-a582-b4b8daea0984 => generated 0 bytes in 1448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:49:33.303989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7f5a92fb-b643-4d20-b580-0fb84e974495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:33.306302 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7f5a92fb-b643-4d20-b580-0fb84e974495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:33.318838 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7f5a92fb-b643-4d20-b580-0fb84e974495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:33.319947 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7f5a92fb-b643-4d20-b580-0fb84e974495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:33.321435 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7f5a92fb-b643-4d20-b580-0fb84e974495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:33.322286 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7f5a92fb-b643-4d20-b580-0fb84e974495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:33.496078 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7f5a92fb-b643-4d20-b580-0fb84e974495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:33.506196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7f5a92fb-b643-4d20-b580-0fb84e974495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:33.508672 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7f5a92fb-b643-4d20-b580-0fb84e974495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:33.509232 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7f5a92fb-b643-4d20-b580-0fb84e974495 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.212735 Jul 18 08:49:33.514236 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 181/379] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:33 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:33.924834 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f577ee4c-9a6e-4e35-961d-e55a78a44f33 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Action: 'create', calling method: .version_select at 0x7fafb73c4700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1233196404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXktWB7fo/xWYBBwEHdsh6PCxxV9arLepWVw+h99gQCeeBsw50vlBOsZeMysDrg7iK70f9D6GaE0ws4y8neCBXdW4scsot1iXpT1pamvw+i82ecm7wIzjNUxU7IaWJVzw=="}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:33.970806 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-f577ee4c-9a6e-4e35-961d-e55a78a44f33 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Getting quotas for project 0a75147b684f470890244abb41bc7d67. Resources: {'key_pairs'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:49:33.977405 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-f577ee4c-9a6e-4e35-961d-e55a78a44f33 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Getting quotas for user 7e134a318a264a1fb870e69de07b8db8 and project 0a75147b684f470890244abb41bc7d67. Resources: {'key_pairs'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:49:34.004926 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f577ee4c-9a6e-4e35-961d-e55a78a44f33 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [46dc2d3b-c066-4efd-8c27-2967a375057d] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 08:49:34.532392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-fd23324e-ea6d-43a4-8c92-4c5336737bcb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:34.533652 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-fd23324e-ea6d-43a4-8c92-4c5336737bcb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:34.545489 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd23324e-ea6d-43a4-8c92-4c5336737bcb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:34.546185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd23324e-ea6d-43a4-8c92-4c5336737bcb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:34.547461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd23324e-ea6d-43a4-8c92-4c5336737bcb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:34.548186 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fd23324e-ea6d-43a4-8c92-4c5336737bcb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:34.776584 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-fd23324e-ea6d-43a4-8c92-4c5336737bcb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:34.787888 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-fd23324e-ea6d-43a4-8c92-4c5336737bcb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:34.790233 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-fd23324e-ea6d-43a4-8c92-4c5336737bcb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:34.791900 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-fd23324e-ea6d-43a4-8c92-4c5336737bcb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.266610 Jul 18 08:49:34.793448 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 182/380] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:34 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:35.030343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO oslo.messaging._drivers.impl_rabbit [None req-f577ee4c-9a6e-4e35-961d-e55a78a44f33 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [46dc2d3b-c066-4efd-8c27-2967a375057d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 37834. Jul 18 08:49:35.214330 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f577ee4c-9a6e-4e35-961d-e55a78a44f33 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.296899 Jul 18 08:49:35.214330 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 199/381] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 08:49:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:35.337579 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-361533265", "imageRef": "c607fcb5-163b-48aa-a08e-6c84c23d3c08", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1233196404", "networks": [{"uuid": "63e2b314-2444-4179-bca4-7e17b3ff5f21"}]}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:35.406315 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] validate_networks() for [('63e2b314-2444-4179-bca4-7e17b3ff5f21', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:49:35.813221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8193f011-2986-4b00-9e16-6cbf7c96ea7f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:35.813984 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8193f011-2986-4b00-9e16-6cbf7c96ea7f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:35.831898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8193f011-2986-4b00-9e16-6cbf7c96ea7f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:35.831898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8193f011-2986-4b00-9e16-6cbf7c96ea7f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:35.831898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8193f011-2986-4b00-9e16-6cbf7c96ea7f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:35.831898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8193f011-2986-4b00-9e16-6cbf7c96ea7f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:35.887907 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:49:35.888717 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:49:35.889153 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:49:35.889620 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:49:35.890039 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:49:35.900725 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:35.902052 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:35.912423 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:35.912423 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:35.929838 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Getting quotas for project 0a75147b684f470890244abb41bc7d67. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:49:35.937328 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Getting quotas for user 7e134a318a264a1fb870e69de07b8db8 and project 0a75147b684f470890244abb41bc7d67. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:49:35.950555 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:49:35.953284 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c607fcb5-163b-48aa-a08e-6c84c23d3c08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:49:35.986177 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8193f011-2986-4b00-9e16-6cbf7c96ea7f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:35.994864 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8193f011-2986-4b00-9e16-6cbf7c96ea7f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:35.996866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8193f011-2986-4b00-9e16-6cbf7c96ea7f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:35.998030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8193f011-2986-4b00-9e16-6cbf7c96ea7f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.190158 Jul 18 08:49:35.998651 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 200/382] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:35 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:36.054042 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-024071f6-3986-485f-951e-a8263056251e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723353 Jul 18 08:49:36.054858 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 183/383] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:49:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:49:36.072868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0e5c76d8-fd9d-4431-885e-86fa02b17e1f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:36.072868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0e5c76d8-fd9d-4431-885e-86fa02b17e1f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:36.141963 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0e5c76d8-fd9d-4431-885e-86fa02b17e1f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:36.150550 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0e5c76d8-fd9d-4431-885e-86fa02b17e1f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1258 microversion: 2.1 time: 0.089291 Jul 18 08:49:36.158656 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 201/384] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:36 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:37.018736 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-731b4789-bd9d-4700-a757-ca0a547db99c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:37.020012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-731b4789-bd9d-4700-a757-ca0a547db99c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:37.029327 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-731b4789-bd9d-4700-a757-ca0a547db99c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:37.029788 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-731b4789-bd9d-4700-a757-ca0a547db99c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:37.040266 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-731b4789-bd9d-4700-a757-ca0a547db99c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:37.040266 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-731b4789-bd9d-4700-a757-ca0a547db99c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:37.179571 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e031235e-3f73-43a2-9515-979c629c7484 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:37.182019 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e031235e-3f73-43a2-9515-979c629c7484 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:37.272163 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-731b4789-bd9d-4700-a757-ca0a547db99c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:37.289831 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-731b4789-bd9d-4700-a757-ca0a547db99c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:37.291645 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-731b4789-bd9d-4700-a757-ca0a547db99c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:37.294867 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-731b4789-bd9d-4700-a757-ca0a547db99c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.281524 Jul 18 08:49:37.296014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 184/385] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:37 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:37.314108 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e031235e-3f73-43a2-9515-979c629c7484 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:37.326031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e031235e-3f73-43a2-9515-979c629c7484 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1258 microversion: 2.1 time: 0.159236 Jul 18 08:49:37.327110 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 202/386] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:37 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:38.109935 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-fb5f8355-aacb-4559-a381-5c4c9d15ec63 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:38.111387 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-fb5f8355-aacb-4559-a381-5c4c9d15ec63 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:38.144509 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fb5f8355-aacb-4559-a381-5c4c9d15ec63 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:38.147589 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fb5f8355-aacb-4559-a381-5c4c9d15ec63 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:38.149285 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fb5f8355-aacb-4559-a381-5c4c9d15ec63 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:38.155091 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fb5f8355-aacb-4559-a381-5c4c9d15ec63 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:38.217726 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-fb5f8355-aacb-4559-a381-5c4c9d15ec63 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19/ips" status: 200 len: 150 microversion: 2.1 time: 0.113599 Jul 18 08:49:38.231612 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 185/387] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 08:49:38 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19/ips => generated 150 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:38.240992 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ecc23a54-d2fe-4af1-8381-a6eb825e9b0d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6a25938-7d9d-4834-9916-9db898082e67"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:38.243691 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ecc23a54-d2fe-4af1-8381-a6eb825e9b0d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:38.254290 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ecc23a54-d2fe-4af1-8381-a6eb825e9b0d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:38.255187 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ecc23a54-d2fe-4af1-8381-a6eb825e9b0d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:38.256409 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ecc23a54-d2fe-4af1-8381-a6eb825e9b0d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:38.257166 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ecc23a54-d2fe-4af1-8381-a6eb825e9b0d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:38.325192 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-147b3fe1-8122-4b47-915c-0c42100b5056 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:38.325192 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-147b3fe1-8122-4b47-915c-0c42100b5056 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:38.337619 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-147b3fe1-8122-4b47-915c-0c42100b5056 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:38.338093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-147b3fe1-8122-4b47-915c-0c42100b5056 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:38.339531 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-147b3fe1-8122-4b47-915c-0c42100b5056 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:38.342511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-147b3fe1-8122-4b47-915c-0c42100b5056 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:38.568038 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-ecc23a54-d2fe-4af1-8381-a6eb825e9b0d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Invalid volume: volume d6a25938-7d9d-4834-9916-9db898082e67 is already attached to instances: 866bad59-8906-4710-9fbb-63e95c376010 Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ecc23a54-d2fe-4af1-8381-a6eb825e9b0d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: POST /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19/os-volume_attachments HTTP/1.1 Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 74 Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:49:38.572884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {"volumeAttachment": {"volumeId": "d6a25938-7d9d-4834-9916-9db898082e67"}} Jul 18 08:49:38.580048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Invalid volume: volume d6a25938-7d9d-4834-9916-9db898082e67 is already attached to instances: 866bad59-8906-4710-9fbb-63e95c376010 Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'server_id': '3b5a1195-56c1-4745-8903-f6bba84a4d19', 'body': {'volumeAttachment': {'volumeId': 'd6a25938-7d9d-4834-9916-9db898082e67'}}} Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d6a25938-7d9d-4834-9916-9db898082e67 is already attached to instances: 866bad59-8906-4710-9fbb-63e95c376010 Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:49:38.581506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d6a25938-7d9d-4834-9916-9db898082e67 is already attached to instances: 866bad59-8906-4710-9fbb-63e95c376010 Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:49:38.583254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:49:38.585597 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:49:38.585597 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:49:38.585597 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:49:38.585597 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d6a25938-7d9d-4834-9916-9db898082e67 is already attached to instances: 866bad59-8906-4710-9fbb-63e95c376010 Jul 18 08:49:38.585597 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:49:38.585597 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ecc23a54-d2fe-4af1-8381-a6eb825e9b0d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 400 to user: Invalid volume: volume d6a25938-7d9d-4834-9916-9db898082e67 is already attached to instances: 866bad59-8906-4710-9fbb-63e95c376010 {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:49:38.585597 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ecc23a54-d2fe-4af1-8381-a6eb825e9b0d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.344113 Jul 18 08:49:38.585597 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 203/388] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:49:38 2022] POST /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19/os-volume_attachments => generated 174 bytes in 350 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 08:49:38.591297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1a605fee-1888-41ed-a77a-12a34384b335 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:38.592089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1a605fee-1888-41ed-a77a-12a34384b335 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:38.601039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1a605fee-1888-41ed-a77a-12a34384b335 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:38.604047 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1a605fee-1888-41ed-a77a-12a34384b335 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:38.604047 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1a605fee-1888-41ed-a77a-12a34384b335 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:38.604047 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1a605fee-1888-41ed-a77a-12a34384b335 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:38.702067 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-147b3fe1-8122-4b47-915c-0c42100b5056 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:38.714903 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-147b3fe1-8122-4b47-915c-0c42100b5056 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:38.717046 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-147b3fe1-8122-4b47-915c-0c42100b5056 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:38.719956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-147b3fe1-8122-4b47-915c-0c42100b5056 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.401674 Jul 18 08:49:38.721991 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 186/389] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:38 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:38.727244 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b88c98fe-aa5f-4611-ac16-dad9559d593a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:38.728151 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b88c98fe-aa5f-4611-ac16-dad9559d593a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:38.737008 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b88c98fe-aa5f-4611-ac16-dad9559d593a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:38.737871 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b88c98fe-aa5f-4611-ac16-dad9559d593a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:38.738926 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b88c98fe-aa5f-4611-ac16-dad9559d593a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:38.739651 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b88c98fe-aa5f-4611-ac16-dad9559d593a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:38.778087 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1a605fee-1888-41ed-a77a-12a34384b335 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:38.790893 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b88c98fe-aa5f-4611-ac16-dad9559d593a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Going to try to terminate instance {{(pid=124895) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:49:38.792173 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1a605fee-1888-41ed-a77a-12a34384b335 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1262 microversion: 2.1 time: 0.210445 Jul 18 08:49:38.803181 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 204/390] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:38 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1262 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:39.269182 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b88c98fe-aa5f-4611-ac16-dad9559d593a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 204 len: 0 microversion: 2.1 time: 0.545071 Jul 18 08:49:39.270419 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 187/391] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:49:38 2022] DELETE /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:49:39.280390 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b95d046c-c8a4-47eb-8b25-2df9dbb01393 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:39.281619 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b95d046c-c8a4-47eb-8b25-2df9dbb01393 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:39.289225 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b95d046c-c8a4-47eb-8b25-2df9dbb01393 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:39.289931 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b95d046c-c8a4-47eb-8b25-2df9dbb01393 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:39.290957 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b95d046c-c8a4-47eb-8b25-2df9dbb01393 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:39.291884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b95d046c-c8a4-47eb-8b25-2df9dbb01393 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:39.531267 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b95d046c-c8a4-47eb-8b25-2df9dbb01393 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:39.533855 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:39.551786 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b95d046c-c8a4-47eb-8b25-2df9dbb01393 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1681 microversion: 2.1 time: 0.268568 Jul 18 08:49:39.562300 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 205/392] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:39 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1681 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:49:39.754884 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-60cb358c-3988-460f-92a3-1cc18b98988a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:39.755164 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-60cb358c-3988-460f-92a3-1cc18b98988a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:39.764797 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60cb358c-3988-460f-92a3-1cc18b98988a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:39.765257 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60cb358c-3988-460f-92a3-1cc18b98988a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:39.767318 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60cb358c-3988-460f-92a3-1cc18b98988a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:39.767901 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60cb358c-3988-460f-92a3-1cc18b98988a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:39.810641 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-406e9649-e7f9-4048-a390-592db5efec22 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:39.811287 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-406e9649-e7f9-4048-a390-592db5efec22 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:39.818567 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-406e9649-e7f9-4048-a390-592db5efec22 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:39.819318 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-406e9649-e7f9-4048-a390-592db5efec22 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:39.833058 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-406e9649-e7f9-4048-a390-592db5efec22 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:39.833058 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-406e9649-e7f9-4048-a390-592db5efec22 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:39.909445 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-406e9649-e7f9-4048-a390-592db5efec22 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:39.917362 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-406e9649-e7f9-4048-a390-592db5efec22 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1254 microversion: 2.1 time: 0.111751 Jul 18 08:49:39.918585 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 206/393] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:39 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1254 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:39.967315 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-60cb358c-3988-460f-92a3-1cc18b98988a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:39.978156 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-60cb358c-3988-460f-92a3-1cc18b98988a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:39.980503 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-60cb358c-3988-460f-92a3-1cc18b98988a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:39.981643 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-60cb358c-3988-460f-92a3-1cc18b98988a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.231811 Jul 18 08:49:39.982221 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 188/394] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:39 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:49:40.575516 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-06a3c958-6433-4eeb-8177-6faa31c7b8bf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:40.576430 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-06a3c958-6433-4eeb-8177-6faa31c7b8bf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:40.592253 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-06a3c958-6433-4eeb-8177-6faa31c7b8bf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:40.593087 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-06a3c958-6433-4eeb-8177-6faa31c7b8bf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:40.594145 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-06a3c958-6433-4eeb-8177-6faa31c7b8bf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:40.594994 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-06a3c958-6433-4eeb-8177-6faa31c7b8bf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:40.953353 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-557ceb55-089f-4741-923e-8827b544497a tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:40.954671 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-557ceb55-089f-4741-923e-8827b544497a tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:40.968657 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-557ceb55-089f-4741-923e-8827b544497a tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:40.971548 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-557ceb55-089f-4741-923e-8827b544497a tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:40.978604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-557ceb55-089f-4741-923e-8827b544497a tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:40.981465 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-557ceb55-089f-4741-923e-8827b544497a tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:41.202238 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-557ceb55-089f-4741-923e-8827b544497a tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:41.212669 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-557ceb55-089f-4741-923e-8827b544497a tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1310 microversion: 2.1 time: 0.280598 Jul 18 08:49:41.213308 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 189/395] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:40 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1310 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:49:41.230789 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0e806d51-d759-40f3-a4b2-744a8d16f474 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:41.235482 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0e806d51-d759-40f3-a4b2-744a8d16f474 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:41.254490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e806d51-d759-40f3-a4b2-744a8d16f474 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:41.255458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e806d51-d759-40f3-a4b2-744a8d16f474 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:41.256622 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e806d51-d759-40f3-a4b2-744a8d16f474 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:41.257065 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e806d51-d759-40f3-a4b2-744a8d16f474 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:41.475261 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-06a3c958-6433-4eeb-8177-6faa31c7b8bf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:41.498864 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-06a3c958-6433-4eeb-8177-6faa31c7b8bf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1681 microversion: 2.1 time: 0.928777 Jul 18 08:49:41.507347 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 207/396] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:40 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1681 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:41.789627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0e806d51-d759-40f3-a4b2-744a8d16f474 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:41.800421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0e806d51-d759-40f3-a4b2-744a8d16f474 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:41.802536 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0e806d51-d759-40f3-a4b2-744a8d16f474 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:41.804458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0e806d51-d759-40f3-a4b2-744a8d16f474 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.578663 Jul 18 08:49:41.805630 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 190/397] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:41 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:41.941060 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bdbae0c6-3145-4698-8b97-13710f10c737 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:41.959828 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bdbae0c6-3145-4698-8b97-13710f10c737 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:41.961113 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bdbae0c6-3145-4698-8b97-13710f10c737 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:42.016059 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bdbae0c6-3145-4698-8b97-13710f10c737 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Going to try to stop instance {{(pid=124894) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 08:49:42.246185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-af45c681-d6bd-4b79-8939-2221204e18df tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:42.248706 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-af45c681-d6bd-4b79-8939-2221204e18df tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:42.257195 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bdbae0c6-3145-4698-8b97-13710f10c737 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "POST /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/action" status: 202 len: 0 microversion: 2.1 time: 0.333498 Jul 18 08:49:42.258015 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 208/398] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:49:41 2022] POST /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:49:42.258558 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-af45c681-d6bd-4b79-8939-2221204e18df tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:42.259202 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-af45c681-d6bd-4b79-8939-2221204e18df tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:42.270731 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-af45c681-d6bd-4b79-8939-2221204e18df tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:42.270731 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-af45c681-d6bd-4b79-8939-2221204e18df tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:42.271031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c632a47b-52b0-4ef3-88c3-72c322ac6d0f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:42.271031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c632a47b-52b0-4ef3-88c3-72c322ac6d0f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:42.318338 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c632a47b-52b0-4ef3-88c3-72c322ac6d0f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:42.321083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c632a47b-52b0-4ef3-88c3-72c322ac6d0f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:42.323229 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c632a47b-52b0-4ef3-88c3-72c322ac6d0f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:42.323795 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c632a47b-52b0-4ef3-88c3-72c322ac6d0f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:42.455771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-af45c681-d6bd-4b79-8939-2221204e18df tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:42.477486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-af45c681-d6bd-4b79-8939-2221204e18df tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1316 microversion: 2.1 time: 0.236106 Jul 18 08:49:42.481042 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 191/399] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:42 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:42.539162 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-60461512-a5aa-442c-a3ce-b280950f4237 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:42.540426 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-60461512-a5aa-442c-a3ce-b280950f4237 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:42.564358 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60461512-a5aa-442c-a3ce-b280950f4237 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:42.565076 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60461512-a5aa-442c-a3ce-b280950f4237 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:42.573819 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60461512-a5aa-442c-a3ce-b280950f4237 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:42.575024 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-60461512-a5aa-442c-a3ce-b280950f4237 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:42.853399 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-60461512-a5aa-442c-a3ce-b280950f4237 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:42.862580 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-60461512-a5aa-442c-a3ce-b280950f4237 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1681 microversion: 2.1 time: 0.328551 Jul 18 08:49:42.863408 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 192/400] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:42 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1681 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:42.872176 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d94f0a93-703c-4049-832a-e6481200f785 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:42.872955 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d94f0a93-703c-4049-832a-e6481200f785 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:42.880712 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d94f0a93-703c-4049-832a-e6481200f785 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:42.881526 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d94f0a93-703c-4049-832a-e6481200f785 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:42.882625 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d94f0a93-703c-4049-832a-e6481200f785 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:42.883316 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d94f0a93-703c-4049-832a-e6481200f785 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:43.011391 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c632a47b-52b0-4ef3-88c3-72c322ac6d0f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:43.036777 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c632a47b-52b0-4ef3-88c3-72c322ac6d0f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1678 microversion: 2.1 time: 0.772361 Jul 18 08:49:43.051780 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 209/401] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:42 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1678 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:43.525922 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-71d09097-ec22-4c93-bc1c-0a552d61ea90 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:43.532126 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-71d09097-ec22-4c93-bc1c-0a552d61ea90 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:43.552757 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71d09097-ec22-4c93-bc1c-0a552d61ea90 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:43.554178 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71d09097-ec22-4c93-bc1c-0a552d61ea90 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:43.556753 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71d09097-ec22-4c93-bc1c-0a552d61ea90 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:43.558483 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71d09097-ec22-4c93-bc1c-0a552d61ea90 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:43.661755 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d94f0a93-703c-4049-832a-e6481200f785 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:43.711445 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d94f0a93-703c-4049-832a-e6481200f785 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:43.715705 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d94f0a93-703c-4049-832a-e6481200f785 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:43.718506 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d94f0a93-703c-4049-832a-e6481200f785 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.853320 Jul 18 08:49:43.752499 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 193/402] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:42 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:43.903192 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-89146416-e445-44ae-a5a1-a6eee3b0a5f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:43.904368 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-89146416-e445-44ae-a5a1-a6eee3b0a5f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:43.938289 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-89146416-e445-44ae-a5a1-a6eee3b0a5f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:43.941466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-89146416-e445-44ae-a5a1-a6eee3b0a5f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:43.943270 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-89146416-e445-44ae-a5a1-a6eee3b0a5f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:43.946136 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-89146416-e445-44ae-a5a1-a6eee3b0a5f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:44.084439 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-71d09097-ec22-4c93-bc1c-0a552d61ea90 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:44.113630 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-71d09097-ec22-4c93-bc1c-0a552d61ea90 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.597397 Jul 18 08:49:44.115078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 210/403] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:43 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:44.127250 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8a3a7960-8129-484e-9ea5-4b45eb2870d6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:44.128091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8a3a7960-8129-484e-9ea5-4b45eb2870d6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:44.138887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8a3a7960-8129-484e-9ea5-4b45eb2870d6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:44.142544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8a3a7960-8129-484e-9ea5-4b45eb2870d6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:44.149787 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8a3a7960-8129-484e-9ea5-4b45eb2870d6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:44.150396 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8a3a7960-8129-484e-9ea5-4b45eb2870d6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:44.645374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-89146416-e445-44ae-a5a1-a6eee3b0a5f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:44.648670 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:44.665272 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-89146416-e445-44ae-a5a1-a6eee3b0a5f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1613 microversion: 2.1 time: 0.767148 Jul 18 08:49:44.677124 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 194/404] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:43 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1613 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:44.752512 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-32ad48d6-ddf1-49a0-8c3f-5ba0803d303e req-af0fd391-8eeb-45ca-995c-ffeb4f012c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b5a1195-56c1-4745-8903-f6bba84a4d19", "name": "network-vif-deleted", "tag": "bf3b9deb-1402-409e-aeab-b183bf26a42e"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:44.766538 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:44.774265 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8a3a7960-8129-484e-9ea5-4b45eb2870d6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:44.785381 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-32ad48d6-ddf1-49a0-8c3f-5ba0803d303e req-af0fd391-8eeb-45ca-995c-ffeb4f012c4a service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:44.785756 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8a3a7960-8129-484e-9ea5-4b45eb2870d6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1678 microversion: 2.1 time: 0.662740 Jul 18 08:49:44.797729 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 211/405] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:44 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1678 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:44.799050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-32ad48d6-ddf1-49a0-8c3f-5ba0803d303e req-af0fd391-8eeb-45ca-995c-ffeb4f012c4a service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:44.816171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-32ad48d6-ddf1-49a0-8c3f-5ba0803d303e req-af0fd391-8eeb-45ca-995c-ffeb4f012c4a service nova] Creating event network-vif-deleted:bf3b9deb-1402-409e-aeab-b183bf26a42e for instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 on hv-cinder-85014 Jul 18 08:49:44.817974 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-11536ce3-277f-4bc0-aa25-50269642d4bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:44.818713 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-11536ce3-277f-4bc0-aa25-50269642d4bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:44.827103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-32ad48d6-ddf1-49a0-8c3f-5ba0803d303e req-af0fd391-8eeb-45ca-995c-ffeb4f012c4a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088957 Jul 18 08:49:44.828719 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 195/406] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:44.842551 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-11536ce3-277f-4bc0-aa25-50269642d4bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:44.842735 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-11536ce3-277f-4bc0-aa25-50269642d4bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:44.848930 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-11536ce3-277f-4bc0-aa25-50269642d4bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:44.850012 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-11536ce3-277f-4bc0-aa25-50269642d4bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:45.064850 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-11536ce3-277f-4bc0-aa25-50269642d4bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:45.076258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-11536ce3-277f-4bc0-aa25-50269642d4bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:45.078867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-11536ce3-277f-4bc0-aa25-50269642d4bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:45.080633 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-11536ce3-277f-4bc0-aa25-50269642d4bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.291135 Jul 18 08:49:45.081448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 212/407] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:44 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:45.142173 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4119af15-d8c0-49a5-93ad-7e3646f95681 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:45.145669 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-4119af15-d8c0-49a5-93ad-7e3646f95681 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:45.162164 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4119af15-d8c0-49a5-93ad-7e3646f95681 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:45.163374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4119af15-d8c0-49a5-93ad-7e3646f95681 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:45.165210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4119af15-d8c0-49a5-93ad-7e3646f95681 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:45.166187 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4119af15-d8c0-49a5-93ad-7e3646f95681 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:45.428367 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4119af15-d8c0-49a5-93ad-7e3646f95681 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:45.440350 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-4119af15-d8c0-49a5-93ad-7e3646f95681 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.305527 Jul 18 08:49:45.452853 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 196/408] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:45 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:45.689628 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c5435606-c5c3-47df-8b14-3068fed099cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:45.692013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c5435606-c5c3-47df-8b14-3068fed099cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:45.708888 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:45.711614 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c5435606-c5c3-47df-8b14-3068fed099cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:45.712463 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c5435606-c5c3-47df-8b14-3068fed099cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:45.718917 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c5435606-c5c3-47df-8b14-3068fed099cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:45.719999 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c5435606-c5c3-47df-8b14-3068fed099cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:45.819462 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c93e31ab-fb4b-4a27-97a5-74da8d00e417 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:45.826647 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c93e31ab-fb4b-4a27-97a5-74da8d00e417 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:45.830997 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c5435606-c5c3-47df-8b14-3068fed099cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:45.854272 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c5435606-c5c3-47df-8b14-3068fed099cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:45.859539 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-c5435606-c5c3-47df-8b14-3068fed099cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lazy-loading 'fault' on Instance uuid 3b5a1195-56c1-4745-8903-f6bba84a4d19 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:49:45.864033 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c93e31ab-fb4b-4a27-97a5-74da8d00e417 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:45.867240 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c93e31ab-fb4b-4a27-97a5-74da8d00e417 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:45.870675 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c93e31ab-fb4b-4a27-97a5-74da8d00e417 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:45.877987 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c93e31ab-fb4b-4a27-97a5-74da8d00e417 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:45.988611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:45.996701 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=6 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:46.054846 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c5435606-c5c3-47df-8b14-3068fed099cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:46.082953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c5435606-c5c3-47df-8b14-3068fed099cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 200 len: 1330 microversion: 2.1 time: 0.400643 Jul 18 08:49:46.083580 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 213/409] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:45 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 1330 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:46.110973 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b96f310d-1fc8-47d0-ba3f-9c1d64c9cbd5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:46.112490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b96f310d-1fc8-47d0-ba3f-9c1d64c9cbd5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:46.129671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b96f310d-1fc8-47d0-ba3f-9c1d64c9cbd5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:46.132813 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b96f310d-1fc8-47d0-ba3f-9c1d64c9cbd5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:46.137937 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b96f310d-1fc8-47d0-ba3f-9c1d64c9cbd5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:46.138708 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b96f310d-1fc8-47d0-ba3f-9c1d64c9cbd5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:46.532850 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c93e31ab-fb4b-4a27-97a5-74da8d00e417 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:46.546854 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c93e31ab-fb4b-4a27-97a5-74da8d00e417 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1678 microversion: 2.1 time: 0.743231 Jul 18 08:49:46.550337 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 197/410] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:45 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1678 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:46.563100 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f5e34037-9383-43bb-8c3b-8813c8fd04d3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:46.564084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f5e34037-9383-43bb-8c3b-8813c8fd04d3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:46.583977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f5e34037-9383-43bb-8c3b-8813c8fd04d3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:46.584928 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f5e34037-9383-43bb-8c3b-8813c8fd04d3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:46.586013 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f5e34037-9383-43bb-8c3b-8813c8fd04d3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:46.592482 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f5e34037-9383-43bb-8c3b-8813c8fd04d3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:46.752765 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b96f310d-1fc8-47d0-ba3f-9c1d64c9cbd5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:46.774981 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b96f310d-1fc8-47d0-ba3f-9c1d64c9cbd5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:46.785008 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b96f310d-1fc8-47d0-ba3f-9c1d64c9cbd5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:46.792236 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b96f310d-1fc8-47d0-ba3f-9c1d64c9cbd5 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.689884 Jul 18 08:49:46.792471 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 214/411] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:46 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:47.268366 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-37a14a18-28aa-4b1f-b2e7-a7dbd2973516 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:47.276909 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-37a14a18-28aa-4b1f-b2e7-a7dbd2973516 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:47.295528 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-37a14a18-28aa-4b1f-b2e7-a7dbd2973516 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:47.299229 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-37a14a18-28aa-4b1f-b2e7-a7dbd2973516 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:47.299229 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-37a14a18-28aa-4b1f-b2e7-a7dbd2973516 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:47.299229 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-37a14a18-28aa-4b1f-b2e7-a7dbd2973516 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:47.321659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=8 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:47.361004 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-37a14a18-28aa-4b1f-b2e7-a7dbd2973516 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-37a14a18-28aa-4b1f-b2e7-a7dbd2973516 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 HTTP/1.1 Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:49:47.371211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:49:47.372967 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '3b5a1195-56c1-4745-8903-f6bba84a4d19'} Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:49:47.373863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:49:47.375361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:49:47.382138 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-37a14a18-28aa-4b1f-b2e7-a7dbd2973516 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:49:47.385030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-37a14a18-28aa-4b1f-b2e7-a7dbd2973516 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 404 len: 111 microversion: 2.1 time: 0.120412 Jul 18 08:49:47.389778 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 215/412] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:47 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:49:47.407732 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d36df0d8-484b-48e2-a29e-94ef95b06153 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '.version_select at 0x7fafb73b88b0>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:47.521127 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d36df0d8-484b-48e2-a29e-94ef95b06153 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-374408592" status: 202 len: 0 microversion: 2.1 time: 0.128123 Jul 18 08:49:47.522672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 216/413] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 08:49:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-374408592 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:49:47.560511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f5e34037-9383-43bb-8c3b-8813c8fd04d3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:47.594399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-4f541ec3-2802-4f97-85fd-68bf16423842 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:47.596159 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f5e34037-9383-43bb-8c3b-8813c8fd04d3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 1.041757 Jul 18 08:49:47.607502 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-4f541ec3-2802-4f97-85fd-68bf16423842 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:47.607693 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 198/414] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:46 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:47.672194 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4f541ec3-2802-4f97-85fd-68bf16423842 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:47.674557 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4f541ec3-2802-4f97-85fd-68bf16423842 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:47.677985 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4f541ec3-2802-4f97-85fd-68bf16423842 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:47.680191 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4f541ec3-2802-4f97-85fd-68bf16423842 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:47.783512 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-74598277-5b49-4a2c-bb34-4f03337ada1c req-178d7bf4-0eed-47b4-a882-444bfd948148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb91124-0b62-4d50-985e-b3e73389fe4e", "tag": "2b862c2d-6596-4494-b33e-d23be8bd6301"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:47.861960 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-74598277-5b49-4a2c-bb34-4f03337ada1c req-178d7bf4-0eed-47b4-a882-444bfd948148 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:47.862460 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-74598277-5b49-4a2c-bb34-4f03337ada1c req-178d7bf4-0eed-47b4-a882-444bfd948148 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:47.906165 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-74598277-5b49-4a2c-bb34-4f03337ada1c req-178d7bf4-0eed-47b4-a882-444bfd948148 service nova] Creating event network-changed:2b862c2d-6596-4494-b33e-d23be8bd6301 for instance 1bb91124-0b62-4d50-985e-b3e73389fe4e on hv-cinder-85014 Jul 18 08:49:47.924959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-74598277-5b49-4a2c-bb34-4f03337ada1c req-178d7bf4-0eed-47b4-a882-444bfd948148 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153220 Jul 18 08:49:47.928642 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 199/415] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:49:47.945225 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0338ad57-3900-49d6-9243-d4d51a495534 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:47.948404 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0338ad57-3900-49d6-9243-d4d51a495534 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:47.962277 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0338ad57-3900-49d6-9243-d4d51a495534 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:47.973151 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0338ad57-3900-49d6-9243-d4d51a495534 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:47.974555 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0338ad57-3900-49d6-9243-d4d51a495534 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:47.975175 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0338ad57-3900-49d6-9243-d4d51a495534 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:48.392065 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-4f541ec3-2802-4f97-85fd-68bf16423842 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:48.427485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-4f541ec3-2802-4f97-85fd-68bf16423842 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1678 microversion: 2.1 time: 0.838811 Jul 18 08:49:48.430465 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 217/416] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:47 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1678 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:48.614598 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-46549ee2-b523-4f0b-abe1-622a715c4f15 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:48.615510 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-46549ee2-b523-4f0b-abe1-622a715c4f15 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:48.638175 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-46549ee2-b523-4f0b-abe1-622a715c4f15 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:48.639060 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-46549ee2-b523-4f0b-abe1-622a715c4f15 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:48.642240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-46549ee2-b523-4f0b-abe1-622a715c4f15 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:48.645051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-46549ee2-b523-4f0b-abe1-622a715c4f15 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:49.020811 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0338ad57-3900-49d6-9243-d4d51a495534 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:49.045197 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0338ad57-3900-49d6-9243-d4d51a495534 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:49.048846 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0338ad57-3900-49d6-9243-d4d51a495534 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:49.053380 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0338ad57-3900-49d6-9243-d4d51a495534 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 1.122875 Jul 18 08:49:49.077383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 200/417] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:47 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:49.263521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-46549ee2-b523-4f0b-abe1-622a715c4f15 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:49.274203 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-46549ee2-b523-4f0b-abe1-622a715c4f15 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.663445 Jul 18 08:49:49.294829 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 218/418] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:48 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:49.458731 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a3b1b096-cafc-44e3-b84f-4e5482e86619 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:49.459357 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a3b1b096-cafc-44e3-b84f-4e5482e86619 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:49.498357 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a3b1b096-cafc-44e3-b84f-4e5482e86619 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:49.498781 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a3b1b096-cafc-44e3-b84f-4e5482e86619 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:49.499638 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a3b1b096-cafc-44e3-b84f-4e5482e86619 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:49.500119 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a3b1b096-cafc-44e3-b84f-4e5482e86619 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:50.100311 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7b041ee4-3359-40fc-bea8-aaa126c7c36e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:50.103055 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7b041ee4-3359-40fc-bea8-aaa126c7c36e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:50.124380 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b041ee4-3359-40fc-bea8-aaa126c7c36e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:50.129377 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b041ee4-3359-40fc-bea8-aaa126c7c36e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:50.130608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b041ee4-3359-40fc-bea8-aaa126c7c36e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:50.139886 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b041ee4-3359-40fc-bea8-aaa126c7c36e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:50.348915 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a3b1b096-cafc-44e3-b84f-4e5482e86619 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:50.366323 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a3b1b096-cafc-44e3-b84f-4e5482e86619 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1678 microversion: 2.1 time: 0.911107 Jul 18 08:49:50.367727 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 201/419] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:49 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1678 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:50.374079 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6f953887-b64b-402a-839e-a958343d2440 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:50.379163 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-6f953887-b64b-402a-839e-a958343d2440 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:50.398335 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6f953887-b64b-402a-839e-a958343d2440 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:50.399164 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6f953887-b64b-402a-839e-a958343d2440 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:50.402403 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6f953887-b64b-402a-839e-a958343d2440 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:50.405970 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6f953887-b64b-402a-839e-a958343d2440 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:50.698725 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7b041ee4-3359-40fc-bea8-aaa126c7c36e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:50.713333 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7b041ee4-3359-40fc-bea8-aaa126c7c36e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:50.719523 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7b041ee4-3359-40fc-bea8-aaa126c7c36e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:50.725966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7b041ee4-3359-40fc-bea8-aaa126c7c36e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.632592 Jul 18 08:49:50.742247 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 219/420] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:50 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:49:50.756259 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a66e4e77-b80c-469d-b16a-94a21c954020 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:50.757850 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a66e4e77-b80c-469d-b16a-94a21c954020 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:50.787488 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a66e4e77-b80c-469d-b16a-94a21c954020 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:50.788702 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a66e4e77-b80c-469d-b16a-94a21c954020 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:50.791115 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a66e4e77-b80c-469d-b16a-94a21c954020 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:50.794206 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a66e4e77-b80c-469d-b16a-94a21c954020 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:50.812458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6f953887-b64b-402a-839e-a958343d2440 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:50.825349 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-6f953887-b64b-402a-839e-a958343d2440 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.455899 Jul 18 08:49:50.833800 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 202/421] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:50 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:50.838517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-284cd9c9-771c-4a02-a97e-220cbb8dff87 req-c2d9809a-fb86-472b-a1ae-98fdb9d1a1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d6245b-0c6d-4a19-85c6-841d85912f2e", "name": "network-vif-plugged", "status": "completed", "tag": "222385f0-b84b-466b-a9f5-dab4e9dadd74"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:50.867623 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-284cd9c9-771c-4a02-a97e-220cbb8dff87 req-c2d9809a-fb86-472b-a1ae-98fdb9d1a1f7 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:50.868537 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-284cd9c9-771c-4a02-a97e-220cbb8dff87 req-c2d9809a-fb86-472b-a1ae-98fdb9d1a1f7 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:50.898710 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-284cd9c9-771c-4a02-a97e-220cbb8dff87 req-c2d9809a-fb86-472b-a1ae-98fdb9d1a1f7 service nova] Creating event network-vif-plugged:222385f0-b84b-466b-a9f5-dab4e9dadd74 for instance f3d6245b-0c6d-4a19-85c6-841d85912f2e on hv-cinder-85014 Jul 18 08:49:50.916268 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-284cd9c9-771c-4a02-a97e-220cbb8dff87 req-c2d9809a-fb86-472b-a1ae-98fdb9d1a1f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082174 Jul 18 08:49:50.920059 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 203/422] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:51.001370 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-a66e4e77-b80c-469d-b16a-94a21c954020 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lazy-loading 'services' on Instance uuid 866bad59-8906-4710-9fbb-63e95c376010 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:49:51.313724 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a66e4e77-b80c-469d-b16a-94a21c954020 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments/d6a25938-7d9d-4834-9916-9db898082e67" status: 202 len: 0 microversion: 2.1 time: 0.569686 Jul 18 08:49:51.325375 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 220/423] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:49:50 2022] DELETE /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments/d6a25938-7d9d-4834-9916-9db898082e67 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:49:51.325692 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9be06899-a839-4e11-b895-86d68a66c214 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:51.325838 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9be06899-a839-4e11-b895-86d68a66c214 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:51.337126 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9be06899-a839-4e11-b895-86d68a66c214 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:51.338151 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9be06899-a839-4e11-b895-86d68a66c214 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:51.339254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9be06899-a839-4e11-b895-86d68a66c214 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:51.340401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9be06899-a839-4e11-b895-86d68a66c214 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:51.408128 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1d8a1ea2-6fc7-44e4-b437-18ca8fab7d47 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:51.409191 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1d8a1ea2-6fc7-44e4-b437-18ca8fab7d47 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:51.418148 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1d8a1ea2-6fc7-44e4-b437-18ca8fab7d47 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:51.419418 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1d8a1ea2-6fc7-44e4-b437-18ca8fab7d47 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:51.422416 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1d8a1ea2-6fc7-44e4-b437-18ca8fab7d47 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:51.423122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1d8a1ea2-6fc7-44e4-b437-18ca8fab7d47 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:51.426822 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9be06899-a839-4e11-b895-86d68a66c214 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107422 Jul 18 08:49:51.429980 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 204/424] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:49:51 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:51.746830 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-50db0fc4-bfbc-4694-8452-de8eff130e39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:51.753582 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-50db0fc4-bfbc-4694-8452-de8eff130e39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:51.755630 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1d8a1ea2-6fc7-44e4-b437-18ca8fab7d47 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:51.769747 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1d8a1ea2-6fc7-44e4-b437-18ca8fab7d47 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1678 microversion: 2.1 time: 0.371198 Jul 18 08:49:51.771197 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 221/425] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:51 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1678 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:51.788031 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50db0fc4-bfbc-4694-8452-de8eff130e39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:51.792647 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50db0fc4-bfbc-4694-8452-de8eff130e39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:51.794121 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50db0fc4-bfbc-4694-8452-de8eff130e39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:51.796174 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50db0fc4-bfbc-4694-8452-de8eff130e39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:51.865606 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a2f2b245-1078-478b-b3e3-997080e2d593 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:51.872054 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a2f2b245-1078-478b-b3e3-997080e2d593 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:51.901182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a2f2b245-1078-478b-b3e3-997080e2d593 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:51.914023 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a2f2b245-1078-478b-b3e3-997080e2d593 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:51.915625 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a2f2b245-1078-478b-b3e3-997080e2d593 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:51.926570 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a2f2b245-1078-478b-b3e3-997080e2d593 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:51.943367 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:52.311881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-50db0fc4-bfbc-4694-8452-de8eff130e39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:52.322526 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-50db0fc4-bfbc-4694-8452-de8eff130e39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:52.324725 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-50db0fc4-bfbc-4694-8452-de8eff130e39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:52.326011 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-50db0fc4-bfbc-4694-8452-de8eff130e39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.584280 Jul 18 08:49:52.326606 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 205/426] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:51 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:49:52.413950 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a2f2b245-1078-478b-b3e3-997080e2d593 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:52.424749 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a2f2b245-1078-478b-b3e3-997080e2d593 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.575573 Jul 18 08:49:52.440551 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 222/427] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:51 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:52.450647 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9944d160-b53e-4330-a093-453185c03e70 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:52.454677 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9944d160-b53e-4330-a093-453185c03e70 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:52.471865 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9944d160-b53e-4330-a093-453185c03e70 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:52.474110 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9944d160-b53e-4330-a093-453185c03e70 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:52.474991 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9944d160-b53e-4330-a093-453185c03e70 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:52.475446 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9944d160-b53e-4330-a093-453185c03e70 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:52.530889 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9944d160-b53e-4330-a093-453185c03e70 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091638 Jul 18 08:49:52.532330 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 223/428] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:49:52 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:52.659878 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c3675504-d5e2-455c-a854-25b4e8e0755e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Action: 'create', calling method: .version_select at 0x7fafb7c91a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-239426097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQO95cwRbDmqcoUu12shTcXkQy8WBgWi3eFkTIXcMRCmBFM3u/k022+Knq9nZ27NHdhVz0QoOuzdZ5aH087FAg7K7RHXI9/zUwKlw5/n/pB1eT6kwoJ2UDj9CBSUWTg3w=="}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:52.679363 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-c3675504-d5e2-455c-a854-25b4e8e0755e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Getting quotas for project d37f9217ffb94786830f0f6c5970b762. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:49:52.685781 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-c3675504-d5e2-455c-a854-25b4e8e0755e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Getting quotas for user ba4946e9565f4a608dd04fbc4de18dad and project d37f9217ffb94786830f0f6c5970b762. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:49:52.790215 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2578af4f-38b5-40db-8925-a8b6ef54b14d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:52.791794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-2578af4f-38b5-40db-8925-a8b6ef54b14d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:52.799366 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c3675504-d5e2-455c-a854-25b4e8e0755e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.471594 Jul 18 08:49:52.800917 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 206/429] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 08:49:52 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:52.812323 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2578af4f-38b5-40db-8925-a8b6ef54b14d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:52.813456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2578af4f-38b5-40db-8925-a8b6ef54b14d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:52.814899 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2578af4f-38b5-40db-8925-a8b6ef54b14d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:52.815947 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2578af4f-38b5-40db-8925-a8b6ef54b14d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:53.079318 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2578af4f-38b5-40db-8925-a8b6ef54b14d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:53.100039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2578af4f-38b5-40db-8925-a8b6ef54b14d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1678 microversion: 2.1 time: 0.313630 Jul 18 08:49:53.103380 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 224/430] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:52 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1678 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:53.355545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8e5de951-07b3-466d-b35b-6d2e33cc18b2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:53.357126 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8e5de951-07b3-466d-b35b-6d2e33cc18b2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:53.378827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8e5de951-07b3-466d-b35b-6d2e33cc18b2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:53.380501 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8e5de951-07b3-466d-b35b-6d2e33cc18b2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:53.382166 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8e5de951-07b3-466d-b35b-6d2e33cc18b2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:53.384156 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8e5de951-07b3-466d-b35b-6d2e33cc18b2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:53.464755 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bbfdbd00-a3df-4fe4-a394-f5611b2e9dbb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:53.467524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bbfdbd00-a3df-4fe4-a394-f5611b2e9dbb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:53.543486 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbfdbd00-a3df-4fe4-a394-f5611b2e9dbb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:53.543486 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbfdbd00-a3df-4fe4-a394-f5611b2e9dbb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:53.543486 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbfdbd00-a3df-4fe4-a394-f5611b2e9dbb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:53.543486 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbfdbd00-a3df-4fe4-a394-f5611b2e9dbb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:53.784388 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-8e5de951-07b3-466d-b35b-6d2e33cc18b2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:53.840542 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-8e5de951-07b3-466d-b35b-6d2e33cc18b2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:53.850990 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-8e5de951-07b3-466d-b35b-6d2e33cc18b2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:53.856080 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8e5de951-07b3-466d-b35b-6d2e33cc18b2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.508990 Jul 18 08:49:53.866784 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 207/431] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:53 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:53.877922 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-63bd8289-fc41-4d0f-b91d-bb1ddf828df8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:53.882859 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-63bd8289-fc41-4d0f-b91d-bb1ddf828df8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:53.899260 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-63bd8289-fc41-4d0f-b91d-bb1ddf828df8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:53.900089 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-63bd8289-fc41-4d0f-b91d-bb1ddf828df8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:53.904575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-63bd8289-fc41-4d0f-b91d-bb1ddf828df8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:53.916975 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bbfdbd00-a3df-4fe4-a394-f5611b2e9dbb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:53.917480 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-63bd8289-fc41-4d0f-b91d-bb1ddf828df8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:53.927596 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bbfdbd00-a3df-4fe4-a394-f5611b2e9dbb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.471132 Jul 18 08:49:53.930215 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 225/432] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:53 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:54.086593 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-63bd8289-fc41-4d0f-b91d-bb1ddf828df8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212562 Jul 18 08:49:54.089360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 208/433] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:49:53 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:54.128010 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5eb3a870-cefd-45d2-ae2c-6181f9769550 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:54.128768 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5eb3a870-cefd-45d2-ae2c-6181f9769550 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:54.138289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5eb3a870-cefd-45d2-ae2c-6181f9769550 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:54.138759 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5eb3a870-cefd-45d2-ae2c-6181f9769550 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:54.140094 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5eb3a870-cefd-45d2-ae2c-6181f9769550 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:54.140690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5eb3a870-cefd-45d2-ae2c-6181f9769550 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:54.429202 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5eb3a870-cefd-45d2-ae2c-6181f9769550 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:54.462067 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5eb3a870-cefd-45d2-ae2c-6181f9769550 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1678 microversion: 2.1 time: 0.344341 Jul 18 08:49:54.488500 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 226/434] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:54 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1678 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:54.917380 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5b596e36-a1da-4979-9c6c-450a111c0bd2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:54.918764 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5b596e36-a1da-4979-9c6c-450a111c0bd2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:54.929420 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b596e36-a1da-4979-9c6c-450a111c0bd2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:54.935185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b596e36-a1da-4979-9c6c-450a111c0bd2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:54.935185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b596e36-a1da-4979-9c6c-450a111c0bd2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:54.935185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b596e36-a1da-4979-9c6c-450a111c0bd2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:54.951946 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f7dcfbb8-0fdd-4f97-a2dd-72b9b6375292 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:54.953196 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f7dcfbb8-0fdd-4f97-a2dd-72b9b6375292 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:54.967656 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7dcfbb8-0fdd-4f97-a2dd-72b9b6375292 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:54.969226 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7dcfbb8-0fdd-4f97-a2dd-72b9b6375292 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:54.970063 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7dcfbb8-0fdd-4f97-a2dd-72b9b6375292 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:54.970510 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7dcfbb8-0fdd-4f97-a2dd-72b9b6375292 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:55.237225 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5b596e36-a1da-4979-9c6c-450a111c0bd2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:55.269949 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5b596e36-a1da-4979-9c6c-450a111c0bd2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:55.274168 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5b596e36-a1da-4979-9c6c-450a111c0bd2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:55.286561 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5b596e36-a1da-4979-9c6c-450a111c0bd2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.374130 Jul 18 08:49:55.291210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 209/435] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:54 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:55.307630 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0a37d542-f51b-43b8-8a74-b186dc6a92a0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:55.309206 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0a37d542-f51b-43b8-8a74-b186dc6a92a0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:55.336948 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f7dcfbb8-0fdd-4f97-a2dd-72b9b6375292 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:55.347946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0a37d542-f51b-43b8-8a74-b186dc6a92a0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:55.348927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0a37d542-f51b-43b8-8a74-b186dc6a92a0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:55.351290 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0a37d542-f51b-43b8-8a74-b186dc6a92a0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:55.351290 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0a37d542-f51b-43b8-8a74-b186dc6a92a0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:55.360301 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f7dcfbb8-0fdd-4f97-a2dd-72b9b6375292 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.409473 Jul 18 08:49:55.371975 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 227/436] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:54 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:55.414919 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0a37d542-f51b-43b8-8a74-b186dc6a92a0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117243 Jul 18 08:49:55.415627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 210/437] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:49:55 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:55.508529 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1017f376-813b-45ea-96a5-09fa08c6292f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:55.510647 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1017f376-813b-45ea-96a5-09fa08c6292f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:55.520959 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1017f376-813b-45ea-96a5-09fa08c6292f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:55.522001 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1017f376-813b-45ea-96a5-09fa08c6292f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:55.523698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1017f376-813b-45ea-96a5-09fa08c6292f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:55.526705 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1017f376-813b-45ea-96a5-09fa08c6292f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:55.878986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1017f376-813b-45ea-96a5-09fa08c6292f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:55.888366 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1017f376-813b-45ea-96a5-09fa08c6292f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1655 microversion: 2.1 time: 0.389455 Jul 18 08:49:55.893096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 228/438] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:55 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1655 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:49:55.912912 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-13174d13-b15e-46c3-93a6-ecb5d49753ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:55.971835 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-13174d13-b15e-46c3-93a6-ecb5d49753ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:55.971835 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-13174d13-b15e-46c3-93a6-ecb5d49753ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:55.971835 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-13174d13-b15e-46c3-93a6-ecb5d49753ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Going to try to start instance {{(pid=124895) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 08:49:56.310183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-cd1e0266-709f-47d5-92ff-ef01648b3c90 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:56.315264 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-cd1e0266-709f-47d5-92ff-ef01648b3c90 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:56.329287 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cd1e0266-709f-47d5-92ff-ef01648b3c90 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:56.331118 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cd1e0266-709f-47d5-92ff-ef01648b3c90 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:56.332115 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cd1e0266-709f-47d5-92ff-ef01648b3c90 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:56.332756 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cd1e0266-709f-47d5-92ff-ef01648b3c90 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:56.424680 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-13174d13-b15e-46c3-93a6-ecb5d49753ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "POST /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/action" status: 202 len: 0 microversion: 2.1 time: 0.516409 Jul 18 08:49:56.429043 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 211/439] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:49:55 2022] POST /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:49:56.441238 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2cb05817-5922-4e0e-a927-556fdb406c1d tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:56.442846 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2cb05817-5922-4e0e-a927-556fdb406c1d tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:56.454397 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2cb05817-5922-4e0e-a927-556fdb406c1d tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:56.457485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2cb05817-5922-4e0e-a927-556fdb406c1d tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:56.457485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2cb05817-5922-4e0e-a927-556fdb406c1d tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:56.457485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2cb05817-5922-4e0e-a927-556fdb406c1d tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:56.757247 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-cd1e0266-709f-47d5-92ff-ef01648b3c90 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:56.774503 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2cb05817-5922-4e0e-a927-556fdb406c1d tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:56.789096 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2cb05817-5922-4e0e-a927-556fdb406c1d tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.358440 Jul 18 08:49:56.798332 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-cd1e0266-709f-47d5-92ff-ef01648b3c90 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:56.798627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 212/440] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:56 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:56.801870 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-cd1e0266-709f-47d5-92ff-ef01648b3c90 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:56.813169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ceebaff0-286a-44dc-93cc-5b277d479282 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:56.818537 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-cd1e0266-709f-47d5-92ff-ef01648b3c90 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.508810 Jul 18 08:49:56.818703 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ceebaff0-286a-44dc-93cc-5b277d479282 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:56.818806 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 229/441] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:56 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:56.851325 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ceebaff0-286a-44dc-93cc-5b277d479282 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:56.851934 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ceebaff0-286a-44dc-93cc-5b277d479282 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:56.853399 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ceebaff0-286a-44dc-93cc-5b277d479282 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:56.854762 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ceebaff0-286a-44dc-93cc-5b277d479282 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:56.866425 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-eb6df1a3-c13e-48d0-8024-f1d5c0b35b11 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:56.867617 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-eb6df1a3-c13e-48d0-8024-f1d5c0b35b11 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:56.890669 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:49:56.905248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eb6df1a3-c13e-48d0-8024-f1d5c0b35b11 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:56.910122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eb6df1a3-c13e-48d0-8024-f1d5c0b35b11 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:56.914782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eb6df1a3-c13e-48d0-8024-f1d5c0b35b11 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:56.920095 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eb6df1a3-c13e-48d0-8024-f1d5c0b35b11 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:56.974125 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ceebaff0-286a-44dc-93cc-5b277d479282 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173722 Jul 18 08:49:56.980535 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 213/442] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:49:56 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:56.988025 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4d4d0b44-b14c-496f-b6f0-dd8ea6dd76db tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d000b557-42bb-4852-9715-319381597a1e"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:49:56.990440 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-4d4d0b44-b14c-496f-b6f0-dd8ea6dd76db tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:57.022766 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4d4d0b44-b14c-496f-b6f0-dd8ea6dd76db tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:57.023488 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4d4d0b44-b14c-496f-b6f0-dd8ea6dd76db tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:57.032807 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4d4d0b44-b14c-496f-b6f0-dd8ea6dd76db tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:57.033889 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4d4d0b44-b14c-496f-b6f0-dd8ea6dd76db tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:57.272922 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-eb6df1a3-c13e-48d0-8024-f1d5c0b35b11 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:57.291253 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-eb6df1a3-c13e-48d0-8024-f1d5c0b35b11 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1664 microversion: 2.1 time: 0.454878 Jul 18 08:49:57.292691 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 230/443] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:56 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1664 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:57.818451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-806727f2-17e8-4286-944d-619891804519 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:57.820344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-806727f2-17e8-4286-944d-619891804519 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:57.830099 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-806727f2-17e8-4286-944d-619891804519 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:57.831030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-806727f2-17e8-4286-944d-619891804519 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:57.832831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-806727f2-17e8-4286-944d-619891804519 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:57.834161 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-806727f2-17e8-4286-944d-619891804519 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:58.320280 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-4d4d0b44-b14c-496f-b6f0-dd8ea6dd76db tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "POST /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.337977 Jul 18 08:49:58.327298 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 214/444] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:49:56 2022] POST /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments => generated 194 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:49:58.333996 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-29cef0ec-5664-4fac-bc26-a9f4d0b47c93 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:58.334865 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-29cef0ec-5664-4fac-bc26-a9f4d0b47c93 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:58.344474 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-29cef0ec-5664-4fac-bc26-a9f4d0b47c93 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:58.345095 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-29cef0ec-5664-4fac-bc26-a9f4d0b47c93 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:58.346978 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-29cef0ec-5664-4fac-bc26-a9f4d0b47c93 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:58.347564 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-29cef0ec-5664-4fac-bc26-a9f4d0b47c93 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:58.446201 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-806727f2-17e8-4286-944d-619891804519 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:58.456969 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-806727f2-17e8-4286-944d-619891804519 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.643224 Jul 18 08:49:58.470639 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 231/445] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:57 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:49:58.481358 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-08b6b622-ab70-46e5-80a0-814b600f11ca tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:58.482952 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-08b6b622-ab70-46e5-80a0-814b600f11ca tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:58.495517 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-08b6b622-ab70-46e5-80a0-814b600f11ca tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:58.496789 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-08b6b622-ab70-46e5-80a0-814b600f11ca tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:58.498004 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-08b6b622-ab70-46e5-80a0-814b600f11ca tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:58.502746 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-08b6b622-ab70-46e5-80a0-814b600f11ca tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:58.542327 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-29cef0ec-5664-4fac-bc26-a9f4d0b47c93 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:58.553073 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-08b6b622-ab70-46e5-80a0-814b600f11ca tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080429 Jul 18 08:49:58.553640 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 232/446] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:49:58 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 08:49:58.559372 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d223a439-77d0-4152-9f0d-ae719b977464 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:58.560169 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d223a439-77d0-4152-9f0d-ae719b977464 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:58.561711 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-29cef0ec-5664-4fac-bc26-a9f4d0b47c93 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:58.565096 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-29cef0ec-5664-4fac-bc26-a9f4d0b47c93 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:58.566995 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-29cef0ec-5664-4fac-bc26-a9f4d0b47c93 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1808 microversion: 2.20 time: 0.237708 Jul 18 08:49:58.568150 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 215/447] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:58 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:58.568319 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d223a439-77d0-4152-9f0d-ae719b977464 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:58.572242 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d223a439-77d0-4152-9f0d-ae719b977464 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:58.572242 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d223a439-77d0-4152-9f0d-ae719b977464 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:58.572242 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d223a439-77d0-4152-9f0d-ae719b977464 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:58.665005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6e54fbe6-1a58-450f-bb30-cca29471ae28 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:58.666022 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-6e54fbe6-1a58-450f-bb30-cca29471ae28 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:58.678387 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6e54fbe6-1a58-450f-bb30-cca29471ae28 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:58.679127 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6e54fbe6-1a58-450f-bb30-cca29471ae28 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:58.680627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6e54fbe6-1a58-450f-bb30-cca29471ae28 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:58.681564 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6e54fbe6-1a58-450f-bb30-cca29471ae28 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:58.730532 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-6e54fbe6-1a58-450f-bb30-cca29471ae28 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Going to try to terminate instance {{(pid=124895) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:49:58.847423 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d223a439-77d0-4152-9f0d-ae719b977464 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:58.859242 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d223a439-77d0-4152-9f0d-ae719b977464 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1664 microversion: 2.1 time: 0.304039 Jul 18 08:49:58.862111 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 233/448] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:58 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1664 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:59.160117 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-6e54fbe6-1a58-450f-bb30-cca29471ae28 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 204 len: 0 microversion: 2.1 time: 0.503844 Jul 18 08:49:59.160909 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 216/449] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:49:58 2022] DELETE /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 08:49:59.171594 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-eece4410-b64f-4fa9-84ce-10dd365a5509 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:59.178683 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-eece4410-b64f-4fa9-84ce-10dd365a5509 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:59.179441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eece4410-b64f-4fa9-84ce-10dd365a5509 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:59.179963 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eece4410-b64f-4fa9-84ce-10dd365a5509 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:59.180832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eece4410-b64f-4fa9-84ce-10dd365a5509 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:59.181365 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-eece4410-b64f-4fa9-84ce-10dd365a5509 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:59.390130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-eece4410-b64f-4fa9-84ce-10dd365a5509 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:59.403875 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-eece4410-b64f-4fa9-84ce-10dd365a5509 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1678 microversion: 2.1 time: 0.237656 Jul 18 08:49:59.404663 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 234/450] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:59 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:49:59.485152 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1381ca5d-0fbc-4511-9238-02a5b74583e0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:59.485152 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1381ca5d-0fbc-4511-9238-02a5b74583e0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:59.498750 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1381ca5d-0fbc-4511-9238-02a5b74583e0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:59.499460 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1381ca5d-0fbc-4511-9238-02a5b74583e0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:59.500740 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1381ca5d-0fbc-4511-9238-02a5b74583e0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:59.501499 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1381ca5d-0fbc-4511-9238-02a5b74583e0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:59.603486 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-4a133981-347e-4f7e-a77f-205930771c80 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:59.605532 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-4a133981-347e-4f7e-a77f-205930771c80 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:59.619324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4a133981-347e-4f7e-a77f-205930771c80 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:59.619324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4a133981-347e-4f7e-a77f-205930771c80 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:59.619324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4a133981-347e-4f7e-a77f-205930771c80 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:59.620353 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4a133981-347e-4f7e-a77f-205930771c80 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:59.695742 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1381ca5d-0fbc-4511-9238-02a5b74583e0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:59.705472 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1381ca5d-0fbc-4511-9238-02a5b74583e0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.231237 Jul 18 08:49:59.706242 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 217/451] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:59 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:49:59.841984 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-4a133981-347e-4f7e-a77f-205930771c80 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:59.856602 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-4a133981-347e-4f7e-a77f-205930771c80 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:59.859055 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-4a133981-347e-4f7e-a77f-205930771c80 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:49:59.860031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-4a133981-347e-4f7e-a77f-205930771c80 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1795 microversion: 2.20 time: 0.262920 Jul 18 08:49:59.860604 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 235/452] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:49:59 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1795 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:49:59.880631 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-26155df2-d409-4303-b698-826f0189cf8e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:49:59.881253 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-26155df2-d409-4303-b698-826f0189cf8e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:49:59.887907 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-26155df2-d409-4303-b698-826f0189cf8e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:59.888212 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-26155df2-d409-4303-b698-826f0189cf8e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:49:59.889002 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-26155df2-d409-4303-b698-826f0189cf8e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:49:59.889440 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-26155df2-d409-4303-b698-826f0189cf8e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:00.034692 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-26155df2-d409-4303-b698-826f0189cf8e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:00.043448 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-26155df2-d409-4303-b698-826f0189cf8e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1664 microversion: 2.1 time: 0.167004 Jul 18 08:50:00.052683 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 218/453] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:49:59 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:00.423341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a3ae24f0-7b7e-427d-82a2-5b53ed3995b8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:00.423909 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a3ae24f0-7b7e-427d-82a2-5b53ed3995b8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:00.430521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3ae24f0-7b7e-427d-82a2-5b53ed3995b8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:00.431105 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3ae24f0-7b7e-427d-82a2-5b53ed3995b8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:00.433011 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3ae24f0-7b7e-427d-82a2-5b53ed3995b8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:00.433784 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3ae24f0-7b7e-427d-82a2-5b53ed3995b8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:00.725799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d57a178b-e4f7-44b6-a500-2e141187a87f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:00.726648 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d57a178b-e4f7-44b6-a500-2e141187a87f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:00.734318 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d57a178b-e4f7-44b6-a500-2e141187a87f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:00.734875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d57a178b-e4f7-44b6-a500-2e141187a87f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:00.735794 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d57a178b-e4f7-44b6-a500-2e141187a87f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:00.736302 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d57a178b-e4f7-44b6-a500-2e141187a87f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:00.870414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a3ae24f0-7b7e-427d-82a2-5b53ed3995b8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:00.878256 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a3ae24f0-7b7e-427d-82a2-5b53ed3995b8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1678 microversion: 2.1 time: 0.459059 Jul 18 08:50:00.878895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 236/454] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:00 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1678 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:00.887541 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d57a178b-e4f7-44b6-a500-2e141187a87f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:00.897434 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d57a178b-e4f7-44b6-a500-2e141187a87f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.175573 Jul 18 08:50:00.898728 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 219/455] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:00 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:01.061360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-11593700-632e-42f3-bcfd-b9bdfe2a67b0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:01.062170 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-11593700-632e-42f3-bcfd-b9bdfe2a67b0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:01.068216 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-11593700-632e-42f3-bcfd-b9bdfe2a67b0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:01.068668 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-11593700-632e-42f3-bcfd-b9bdfe2a67b0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:01.069439 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-11593700-632e-42f3-bcfd-b9bdfe2a67b0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:01.069877 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-11593700-632e-42f3-bcfd-b9bdfe2a67b0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:01.221390 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-11593700-632e-42f3-bcfd-b9bdfe2a67b0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:01.232948 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-11593700-632e-42f3-bcfd-b9bdfe2a67b0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1664 microversion: 2.1 time: 0.175836 Jul 18 08:50:01.233543 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 237/456] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:01 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1664 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:01.896778 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-79d113f6-6454-4902-a524-28c392d9e3be tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:01.897436 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-79d113f6-6454-4902-a524-28c392d9e3be tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:01.907223 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-79d113f6-6454-4902-a524-28c392d9e3be tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:01.907713 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-79d113f6-6454-4902-a524-28c392d9e3be tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:01.908511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-79d113f6-6454-4902-a524-28c392d9e3be tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:01.908956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-79d113f6-6454-4902-a524-28c392d9e3be tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:01.919415 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5ed8ca81-aece-4f88-8ae9-b13482361adc tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:01.921346 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5ed8ca81-aece-4f88-8ae9-b13482361adc tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:01.929894 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ed8ca81-aece-4f88-8ae9-b13482361adc tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:01.931865 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ed8ca81-aece-4f88-8ae9-b13482361adc tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:01.933945 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ed8ca81-aece-4f88-8ae9-b13482361adc tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:01.935702 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ed8ca81-aece-4f88-8ae9-b13482361adc tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:02.060181 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-79d113f6-6454-4902-a524-28c392d9e3be tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:02.068192 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-79d113f6-6454-4902-a524-28c392d9e3be tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1678 microversion: 2.1 time: 0.175263 Jul 18 08:50:02.068759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 220/457] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:01 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:02.189109 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5ed8ca81-aece-4f88-8ae9-b13482361adc tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:02.191547 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=100 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:02.198423 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5ed8ca81-aece-4f88-8ae9-b13482361adc tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.283777 Jul 18 08:50:02.199417 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 238/458] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:01 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:02.251402 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-20faaca3-7334-4f67-b92b-b5d553075390 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:02.263093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-20faaca3-7334-4f67-b92b-b5d553075390 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:02.263093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-20faaca3-7334-4f67-b92b-b5d553075390 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:02.263093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-20faaca3-7334-4f67-b92b-b5d553075390 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:02.263093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-20faaca3-7334-4f67-b92b-b5d553075390 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:02.263483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-20faaca3-7334-4f67-b92b-b5d553075390 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:02.426569 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-20faaca3-7334-4f67-b92b-b5d553075390 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:02.434832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-20faaca3-7334-4f67-b92b-b5d553075390 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1668 microversion: 2.1 time: 0.187446 Jul 18 08:50:02.435409 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 221/459] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:02 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1668 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:02.850782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-5a0ad4e1-ae84-449e-a421-3ab906364df9 req-d61ff7f3-9f6d-47c0-99bf-2561e5f03253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866bad59-8906-4710-9fbb-63e95c376010", "name": "network-vif-deleted", "tag": "47a3e70e-f8bb-43b0-84c0-a2b560f6cacd"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:02.862602 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-5a0ad4e1-ae84-449e-a421-3ab906364df9 req-d61ff7f3-9f6d-47c0-99bf-2561e5f03253 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:02.863344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-5a0ad4e1-ae84-449e-a421-3ab906364df9 req-d61ff7f3-9f6d-47c0-99bf-2561e5f03253 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:02.876754 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-5a0ad4e1-ae84-449e-a421-3ab906364df9 req-d61ff7f3-9f6d-47c0-99bf-2561e5f03253 service nova] Creating event network-vif-deleted:47a3e70e-f8bb-43b0-84c0-a2b560f6cacd for instance 866bad59-8906-4710-9fbb-63e95c376010 on hv-cinder-85014 Jul 18 08:50:02.889062 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-5a0ad4e1-ae84-449e-a421-3ab906364df9 req-d61ff7f3-9f6d-47c0-99bf-2561e5f03253 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053763 Jul 18 08:50:02.889678 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 239/460] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:03.088112 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-93fb540e-7df9-4945-8596-cdcd5fe38847 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:03.089319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-93fb540e-7df9-4945-8596-cdcd5fe38847 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:03.091163 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=4 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:03.096817 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-93fb540e-7df9-4945-8596-cdcd5fe38847 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:03.097272 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-93fb540e-7df9-4945-8596-cdcd5fe38847 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:03.098062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-93fb540e-7df9-4945-8596-cdcd5fe38847 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:03.098498 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-93fb540e-7df9-4945-8596-cdcd5fe38847 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:03.173427 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-93fb540e-7df9-4945-8596-cdcd5fe38847 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:03.181434 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-93fb540e-7df9-4945-8596-cdcd5fe38847 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1325 microversion: 2.1 time: 0.097146 Jul 18 08:50:03.182527 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 222/461] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:03 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1325 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:03.221741 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e0875788-248d-4d8c-af29-da9bf3f85281 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:03.222467 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e0875788-248d-4d8c-af29-da9bf3f85281 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:03.229019 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e0875788-248d-4d8c-af29-da9bf3f85281 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:03.230170 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e0875788-248d-4d8c-af29-da9bf3f85281 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:03.231232 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e0875788-248d-4d8c-af29-da9bf3f85281 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:03.231859 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e0875788-248d-4d8c-af29-da9bf3f85281 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:03.407033 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e0875788-248d-4d8c-af29-da9bf3f85281 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:03.415691 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e0875788-248d-4d8c-af29-da9bf3f85281 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.198658 Jul 18 08:50:03.416839 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 240/462] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:03 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:04.194377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-556089d0-af13-4085-85b4-6909383a145b req-b71418c8-c5cd-4cc6-ae73-4c0e07f9f685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb91124-0b62-4d50-985e-b3e73389fe4e", "name": "network-vif-plugged", "status": "completed", "tag": "2b862c2d-6596-4494-b33e-d23be8bd6301"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:04.203601 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-cb174fe3-c4ea-4f4e-986c-322ca5b0f1cd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:04.204628 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-cb174fe3-c4ea-4f4e-986c-322ca5b0f1cd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:04.207613 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-556089d0-af13-4085-85b4-6909383a145b req-b71418c8-c5cd-4cc6-ae73-4c0e07f9f685 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:04.208098 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-556089d0-af13-4085-85b4-6909383a145b req-b71418c8-c5cd-4cc6-ae73-4c0e07f9f685 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:04.212897 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cb174fe3-c4ea-4f4e-986c-322ca5b0f1cd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:04.214310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cb174fe3-c4ea-4f4e-986c-322ca5b0f1cd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:04.215350 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cb174fe3-c4ea-4f4e-986c-322ca5b0f1cd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:04.215995 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cb174fe3-c4ea-4f4e-986c-322ca5b0f1cd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:04.221640 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-556089d0-af13-4085-85b4-6909383a145b req-b71418c8-c5cd-4cc6-ae73-4c0e07f9f685 service nova] Creating event network-vif-plugged:2b862c2d-6596-4494-b33e-d23be8bd6301 for instance 1bb91124-0b62-4d50-985e-b3e73389fe4e on hv-cinder-85014 Jul 18 08:50:04.226858 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-556089d0-af13-4085-85b4-6909383a145b req-b71418c8-c5cd-4cc6-ae73-4c0e07f9f685 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038842 Jul 18 08:50:04.230191 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 223/463] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:04.264234 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cb174fe3-c4ea-4f4e-986c-322ca5b0f1cd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:04.264802 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cb174fe3-c4ea-4f4e-986c-322ca5b0f1cd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:04.265660 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-cb174fe3-c4ea-4f4e-986c-322ca5b0f1cd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lazy-loading 'fault' on Instance uuid 866bad59-8906-4710-9fbb-63e95c376010 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:50:04.313368 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-cb174fe3-c4ea-4f4e-986c-322ca5b0f1cd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:04.319521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-cb174fe3-c4ea-4f4e-986c-322ca5b0f1cd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 200 len: 1330 microversion: 2.1 time: 0.124800 Jul 18 08:50:04.321033 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 241/464] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:04 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 1330 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:04.435507 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d692c5f3-6544-4a95-8c9f-f5abacefa394 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:04.436570 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d692c5f3-6544-4a95-8c9f-f5abacefa394 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:04.443244 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d692c5f3-6544-4a95-8c9f-f5abacefa394 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:04.443719 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d692c5f3-6544-4a95-8c9f-f5abacefa394 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:04.444516 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d692c5f3-6544-4a95-8c9f-f5abacefa394 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:04.444954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d692c5f3-6544-4a95-8c9f-f5abacefa394 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:04.612480 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d692c5f3-6544-4a95-8c9f-f5abacefa394 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:04.620466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d692c5f3-6544-4a95-8c9f-f5abacefa394 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.190030 Jul 18 08:50:04.621280 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 224/465] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:04 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:05.338915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-92d1e78c-e2a8-4d74-ba6d-ab40522b2050 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:05.339537 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-92d1e78c-e2a8-4d74-ba6d-ab40522b2050 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:05.345999 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-92d1e78c-e2a8-4d74-ba6d-ab40522b2050 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:05.346453 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-92d1e78c-e2a8-4d74-ba6d-ab40522b2050 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:05.347263 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-92d1e78c-e2a8-4d74-ba6d-ab40522b2050 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:05.347826 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-92d1e78c-e2a8-4d74-ba6d-ab40522b2050 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:05.364083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-92d1e78c-e2a8-4d74-ba6d-ab40522b2050 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-92d1e78c-e2a8-4d74-ba6d-ab40522b2050 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 HTTP/1.1 Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:50:05.365730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:50:05.367327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '866bad59-8906-4710-9fbb-63e95c376010'} Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:50:05.368171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:50:05.370360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:50:05.371485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-92d1e78c-e2a8-4d74-ba6d-ab40522b2050 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:50:05.371485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-92d1e78c-e2a8-4d74-ba6d-ab40522b2050 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 404 len: 111 microversion: 2.1 time: 0.033165 Jul 18 08:50:05.371485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 242/466] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:05 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:50:05.377035 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-116f91f8-1cfb-4e71-a83b-4e774c6cf909 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '.version_select at 0x7fafb72d3310>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:05.457925 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-116f91f8-1cfb-4e71-a83b-4e774c6cf909 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-487120895" status: 202 len: 0 microversion: 2.1 time: 0.084711 Jul 18 08:50:05.458536 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 225/467] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 08:50:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-487120895 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 08:50:05.640340 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d6dcbf70-f68d-4072-b851-d31163f98b93 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:05.640968 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d6dcbf70-f68d-4072-b851-d31163f98b93 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:05.647322 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d6dcbf70-f68d-4072-b851-d31163f98b93 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:05.647837 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d6dcbf70-f68d-4072-b851-d31163f98b93 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:05.654620 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d6dcbf70-f68d-4072-b851-d31163f98b93 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:05.654620 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d6dcbf70-f68d-4072-b851-d31163f98b93 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:05.875753 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d6dcbf70-f68d-4072-b851-d31163f98b93 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:05.886311 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d6dcbf70-f68d-4072-b851-d31163f98b93 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1358 microversion: 2.1 time: 0.248547 Jul 18 08:50:05.887272 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 243/468] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:05 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:06.414357 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-cf56fc49-9cef-4592-a5a0-48c1ede878f1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: .version_select at 0x7fafb7307b80>, body: {"keypair": {"name": "tempest-keypair-1894252202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdIRqfJB4EMoNKhUbEcyH1U+GzPCn3VNqAOd5rXncMheVRuJLqIVGnk/wrCm4njXgBT4zWo21LPnhWbxdmoqNQM+7EdQmOmf/4zqhC11j3v7cS2b2FIf/gw6u9yeY13YA=="}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:06.431342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-cf56fc49-9cef-4592-a5a0-48c1ede878f1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:50:06.436369 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-cf56fc49-9cef-4592-a5a0-48c1ede878f1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for user 4e6b788e0819483580c09902a341ea6d and project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:50:06.549346 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-cf56fc49-9cef-4592-a5a0-48c1ede878f1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136717 Jul 18 08:50:06.551419 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 226/469] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 08:50:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:06.906838 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-349bc94c-8526-48b4-9d34-d4e0be8a7956 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:06.907466 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-349bc94c-8526-48b4-9d34-d4e0be8a7956 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:06.914954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-349bc94c-8526-48b4-9d34-d4e0be8a7956 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:06.915419 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-349bc94c-8526-48b4-9d34-d4e0be8a7956 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:06.916376 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-349bc94c-8526-48b4-9d34-d4e0be8a7956 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:06.916713 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-349bc94c-8526-48b4-9d34-d4e0be8a7956 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:07.095757 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-349bc94c-8526-48b4-9d34-d4e0be8a7956 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:07.110709 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-349bc94c-8526-48b4-9d34-d4e0be8a7956 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1549 microversion: 2.1 time: 0.207734 Jul 18 08:50:07.111611 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 244/470] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:06 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1549 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:07.129957 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e37b23bc-31ed-4fd8-94ce-6f50b66f651f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:07.130677 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e37b23bc-31ed-4fd8-94ce-6f50b66f651f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:07.137868 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e37b23bc-31ed-4fd8-94ce-6f50b66f651f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:07.138590 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e37b23bc-31ed-4fd8-94ce-6f50b66f651f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:07.139743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e37b23bc-31ed-4fd8-94ce-6f50b66f651f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:07.140355 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e37b23bc-31ed-4fd8-94ce-6f50b66f651f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:07.315948 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e37b23bc-31ed-4fd8-94ce-6f50b66f651f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:07.326180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e37b23bc-31ed-4fd8-94ce-6f50b66f651f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1549 microversion: 2.1 time: 0.200214 Jul 18 08:50:07.326791 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 227/471] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:07 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1549 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:07.344057 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e7f6d6cf-c348-41c3-96e8-848ce06f3052 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:07.347320 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e7f6d6cf-c348-41c3-96e8-848ce06f3052 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:07.348108 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e7f6d6cf-c348-41c3-96e8-848ce06f3052 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Searching by: {'deleted': False, 'project_id': '0a75147b684f470890244abb41bc7d67'} {{(pid=124894) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 08:50:07.355547 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7f6d6cf-c348-41c3-96e8-848ce06f3052 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:07.356034 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7f6d6cf-c348-41c3-96e8-848ce06f3052 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:07.356825 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7f6d6cf-c348-41c3-96e8-848ce06f3052 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:07.357251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7f6d6cf-c348-41c3-96e8-848ce06f3052 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:07.449475 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.multi_cell_list [None req-e7f6d6cf-c348-41c3-96e8-848ce06f3052 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124894) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 08:50:07.557128 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e7f6d6cf-c348-41c3-96e8-848ce06f3052 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.216715 Jul 18 08:50:07.558099 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 245/472] 10.222.0.57 () {58 vars in 1124 bytes} [Mon Jul 18 08:50:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:07.569280 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b06ddbe0-0c15-4a93-805e-d413f64af9f1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:07.569897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b06ddbe0-0c15-4a93-805e-d413f64af9f1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:07.577284 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b06ddbe0-0c15-4a93-805e-d413f64af9f1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:07.577777 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b06ddbe0-0c15-4a93-805e-d413f64af9f1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:07.578938 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b06ddbe0-0c15-4a93-805e-d413f64af9f1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:07.579431 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b06ddbe0-0c15-4a93-805e-d413f64af9f1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:07.734595 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b06ddbe0-0c15-4a93-805e-d413f64af9f1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:07.746540 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b06ddbe0-0c15-4a93-805e-d413f64af9f1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1549 microversion: 2.1 time: 0.181022 Jul 18 08:50:07.747131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 228/473] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:07 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1549 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:08.283884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7f124932-2116-4939-b800-01f7bac714fa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:08.284865 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7f124932-2116-4939-b800-01f7bac714fa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:08.292154 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7f124932-2116-4939-b800-01f7bac714fa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:08.292618 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7f124932-2116-4939-b800-01f7bac714fa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:08.293423 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7f124932-2116-4939-b800-01f7bac714fa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:08.293969 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7f124932-2116-4939-b800-01f7bac714fa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:08.323003 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-7f124932-2116-4939-b800-01f7bac714fa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lazy-loading 'flavor' on Instance uuid f3d75586-3142-49ba-b48b-9db088664de7 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:50:08.672015 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7f124932-2116-4939-b800-01f7bac714fa tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "POST /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/action" status: 200 len: 32 microversion: 2.1 time: 0.390377 Jul 18 08:50:08.672015 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 246/474] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:50:08 2022] POST /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 08:50:08.681398 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4f66f631-7e21-4df5-b2a4-0127f17b76b8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:08.682925 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-4f66f631-7e21-4df5-b2a4-0127f17b76b8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:08.705169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4f66f631-7e21-4df5-b2a4-0127f17b76b8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:08.705629 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4f66f631-7e21-4df5-b2a4-0127f17b76b8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:08.706462 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4f66f631-7e21-4df5-b2a4-0127f17b76b8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:08.706907 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4f66f631-7e21-4df5-b2a4-0127f17b76b8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:08.894691 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4f66f631-7e21-4df5-b2a4-0127f17b76b8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:08.897460 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:08.905065 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-4f66f631-7e21-4df5-b2a4-0127f17b76b8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.228817 Jul 18 08:50:08.905651 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 229/475] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:08 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:09.552165 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1174349819", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91d2b33d-7b11-4b88-9cd3-44537bfe048d"}], "security_groups": [{"name": "tempest-securitygroup--2070835608"}], "key_name": "tempest-keypair-1894252202", "user_data": "}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:09.715266 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.network.neutron [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] validate_networks() for [('91d2b33d-7b11-4b88-9cd3-44537bfe048d', None, None, None, None, None)] {{(pid=124894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:50:09.925675 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-cf17824d-a6f9-4b3f-bf59-2027410bf2b7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:09.926405 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-cf17824d-a6f9-4b3f-bf59-2027410bf2b7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:09.939504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf17824d-a6f9-4b3f-bf59-2027410bf2b7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:09.940125 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf17824d-a6f9-4b3f-bf59-2027410bf2b7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:09.941102 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf17824d-a6f9-4b3f-bf59-2027410bf2b7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:09.941689 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf17824d-a6f9-4b3f-bf59-2027410bf2b7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:10.112567 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-cf17824d-a6f9-4b3f-bf59-2027410bf2b7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:10.121492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-cf17824d-a6f9-4b3f-bf59-2027410bf2b7 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.202500 Jul 18 08:50:10.122084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 230/476] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:09 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:10.133583 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7ddfbca5-fc40-4549-89ad-213b34a5bf9b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd91af13-76d9-40d1-b4f0-0dae83578017"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:10.135351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7ddfbca5-fc40-4549-89ad-213b34a5bf9b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:10.137860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:10.146352 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ddfbca5-fc40-4549-89ad-213b34a5bf9b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:10.146802 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ddfbca5-fc40-4549-89ad-213b34a5bf9b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:10.147590 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ddfbca5-fc40-4549-89ad-213b34a5bf9b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:10.148071 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ddfbca5-fc40-4549-89ad-213b34a5bf9b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:10.196763 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Flavor limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:50:10.197221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Image limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:50:10.198615 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Flavor pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:50:10.199043 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Image pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:50:10.199641 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:50:10.212959 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:10.214196 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:10.215030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:10.215480 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:10.236676 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:50:10.246324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for user 4e6b788e0819483580c09902a341ea6d and project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:50:10.260117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Going to run 1 instances... {{(pid=124894) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:50:10.262718 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:50:10.397532 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ae232926-0912-4ef1-b723-f6a64480ae2c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.851359 Jul 18 08:50:10.398115 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 247/477] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:50:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:50:10.408938 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-345b25d8-9c9b-4028-a5c7-9608a18fad60 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:10.409565 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-345b25d8-9c9b-4028-a5c7-9608a18fad60 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:10.479621 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-345b25d8-9c9b-4028-a5c7-9608a18fad60 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:10.490800 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-345b25d8-9c9b-4028-a5c7-9608a18fad60 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1242 microversion: 2.1 time: 0.085100 Jul 18 08:50:10.491269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 248/478] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:10 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:10.998991 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7ddfbca5-fc40-4549-89ad-213b34a5bf9b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "POST /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.869284 Jul 18 08:50:11.000000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 231/479] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:50:10 2022] POST /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments => generated 194 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:11.138514 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8fb151c1-5cf1-4298-bbda-c03aa43f9c7d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:11.139152 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8fb151c1-5cf1-4298-bbda-c03aa43f9c7d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:11.146209 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8fb151c1-5cf1-4298-bbda-c03aa43f9c7d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:11.146666 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8fb151c1-5cf1-4298-bbda-c03aa43f9c7d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:11.147428 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8fb151c1-5cf1-4298-bbda-c03aa43f9c7d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:11.147892 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8fb151c1-5cf1-4298-bbda-c03aa43f9c7d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:11.301882 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8fb151c1-5cf1-4298-bbda-c03aa43f9c7d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:11.312914 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8fb151c1-5cf1-4298-bbda-c03aa43f9c7d tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.178273 Jul 18 08:50:11.313671 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 249/480] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:11 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:11.511615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-bf93f8f8-3b6c-4831-908e-e2e8bfe7f8ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:11.512216 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-bf93f8f8-3b6c-4831-908e-e2e8bfe7f8ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:11.519063 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bf93f8f8-3b6c-4831-908e-e2e8bfe7f8ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:11.519696 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bf93f8f8-3b6c-4831-908e-e2e8bfe7f8ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:11.520985 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bf93f8f8-3b6c-4831-908e-e2e8bfe7f8ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:11.521566 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bf93f8f8-3b6c-4831-908e-e2e8bfe7f8ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:11.594862 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-bf93f8f8-3b6c-4831-908e-e2e8bfe7f8ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:11.603565 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-bf93f8f8-3b6c-4831-908e-e2e8bfe7f8ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1246 microversion: 2.1 time: 0.097600 Jul 18 08:50:11.608819 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 232/481] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:11 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:12.335533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7094b5d4-6949-4d9e-9443-2da7062d4e8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:12.336743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7094b5d4-6949-4d9e-9443-2da7062d4e8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:12.348538 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7094b5d4-6949-4d9e-9443-2da7062d4e8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:12.349341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7094b5d4-6949-4d9e-9443-2da7062d4e8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:12.350618 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7094b5d4-6949-4d9e-9443-2da7062d4e8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:12.351456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7094b5d4-6949-4d9e-9443-2da7062d4e8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:12.506046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7094b5d4-6949-4d9e-9443-2da7062d4e8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:12.516855 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7094b5d4-6949-4d9e-9443-2da7062d4e8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.188859 Jul 18 08:50:12.517439 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 250/482] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:12 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:12.621909 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b89ddbcb-1a11-4b6d-9ffb-96bfb2db5da9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:12.622730 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b89ddbcb-1a11-4b6d-9ffb-96bfb2db5da9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:12.629794 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b89ddbcb-1a11-4b6d-9ffb-96bfb2db5da9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:12.630250 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b89ddbcb-1a11-4b6d-9ffb-96bfb2db5da9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:12.631053 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b89ddbcb-1a11-4b6d-9ffb-96bfb2db5da9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:12.631487 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b89ddbcb-1a11-4b6d-9ffb-96bfb2db5da9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:12.699170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b89ddbcb-1a11-4b6d-9ffb-96bfb2db5da9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:12.707231 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b89ddbcb-1a11-4b6d-9ffb-96bfb2db5da9 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1294 microversion: 2.1 time: 0.090176 Jul 18 08:50:12.707841 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 233/483] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:12 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:13.540053 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ec560286-3b88-40ae-aee0-b3bd6bf3526a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:13.540731 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ec560286-3b88-40ae-aee0-b3bd6bf3526a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:13.543966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:13.549404 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec560286-3b88-40ae-aee0-b3bd6bf3526a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:13.549750 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec560286-3b88-40ae-aee0-b3bd6bf3526a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:13.550517 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec560286-3b88-40ae-aee0-b3bd6bf3526a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:13.550950 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec560286-3b88-40ae-aee0-b3bd6bf3526a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:13.725230 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3359f502-eab0-4561-9bbe-f54da5a69f09 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:13.725778 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3359f502-eab0-4561-9bbe-f54da5a69f09 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:13.734768 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3359f502-eab0-4561-9bbe-f54da5a69f09 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:13.735223 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3359f502-eab0-4561-9bbe-f54da5a69f09 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:13.736038 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3359f502-eab0-4561-9bbe-f54da5a69f09 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:13.736478 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3359f502-eab0-4561-9bbe-f54da5a69f09 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:13.789902 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ec560286-3b88-40ae-aee0-b3bd6bf3526a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:13.801349 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ec560286-3b88-40ae-aee0-b3bd6bf3526a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.265044 Jul 18 08:50:13.802454 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 251/484] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:13 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:13.829353 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3359f502-eab0-4561-9bbe-f54da5a69f09 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:13.837603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3359f502-eab0-4561-9bbe-f54da5a69f09 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1300 microversion: 2.1 time: 0.116175 Jul 18 08:50:13.839086 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 234/485] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:13 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1300 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:14.820418 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3e5961f7-b753-436e-a91b-318780442a4a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:14.821034 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-3e5961f7-b753-436e-a91b-318780442a4a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:14.829586 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3e5961f7-b753-436e-a91b-318780442a4a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:14.830123 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3e5961f7-b753-436e-a91b-318780442a4a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:14.830961 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3e5961f7-b753-436e-a91b-318780442a4a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:14.831504 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3e5961f7-b753-436e-a91b-318780442a4a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:14.858622 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0b0f2aad-3ea5-447d-b6e7-a2d9207c3b54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:14.859799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0b0f2aad-3ea5-447d-b6e7-a2d9207c3b54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:14.868166 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b0f2aad-3ea5-447d-b6e7-a2d9207c3b54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:14.868700 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b0f2aad-3ea5-447d-b6e7-a2d9207c3b54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:14.869677 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b0f2aad-3ea5-447d-b6e7-a2d9207c3b54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:14.870279 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b0f2aad-3ea5-447d-b6e7-a2d9207c3b54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:15.048614 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0b0f2aad-3ea5-447d-b6e7-a2d9207c3b54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:15.057360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0b0f2aad-3ea5-447d-b6e7-a2d9207c3b54 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1368 microversion: 2.1 time: 0.203726 Jul 18 08:50:15.066028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 235/486] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:14 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:15.153410 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-3e5961f7-b753-436e-a91b-318780442a4a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:15.162172 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-3e5961f7-b753-436e-a91b-318780442a4a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.346020 Jul 18 08:50:15.163110 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 252/487] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:14 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:15.380993 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-7c53eff6-f97e-461a-b529-79d4e1377785 req-7de0221c-30b2-4154-86fd-98812a8085d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b503f6b2-890d-41b0-9323-5af163d8a016", "tag": "c9bbf27b-9770-4d9c-8c89-bef4da1b48d3"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:15.392207 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-7c53eff6-f97e-461a-b529-79d4e1377785 req-7de0221c-30b2-4154-86fd-98812a8085d8 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:15.392768 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-7c53eff6-f97e-461a-b529-79d4e1377785 req-7de0221c-30b2-4154-86fd-98812a8085d8 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:15.409210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-7c53eff6-f97e-461a-b529-79d4e1377785 req-7de0221c-30b2-4154-86fd-98812a8085d8 service nova] Creating event network-changed:c9bbf27b-9770-4d9c-8c89-bef4da1b48d3 for instance b503f6b2-890d-41b0-9323-5af163d8a016 on hv-cinder-85014 Jul 18 08:50:15.414120 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-7c53eff6-f97e-461a-b529-79d4e1377785 req-7de0221c-30b2-4154-86fd-98812a8085d8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041236 Jul 18 08:50:15.414730 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 236/488] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:16.075459 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-39f0c23f-af1d-4a62-8c94-792f08d7a1db tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:16.076350 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-39f0c23f-af1d-4a62-8c94-792f08d7a1db tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:16.083773 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39f0c23f-af1d-4a62-8c94-792f08d7a1db tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:16.084228 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39f0c23f-af1d-4a62-8c94-792f08d7a1db tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:16.085030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39f0c23f-af1d-4a62-8c94-792f08d7a1db tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:16.085470 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39f0c23f-af1d-4a62-8c94-792f08d7a1db tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:16.187876 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-527b46e2-a93c-42b1-b162-e29c4291b81f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:16.190503 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-527b46e2-a93c-42b1-b162-e29c4291b81f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:16.205784 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-527b46e2-a93c-42b1-b162-e29c4291b81f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:16.206638 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-527b46e2-a93c-42b1-b162-e29c4291b81f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:16.208462 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-527b46e2-a93c-42b1-b162-e29c4291b81f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:16.209405 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-527b46e2-a93c-42b1-b162-e29c4291b81f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:16.369734 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-39f0c23f-af1d-4a62-8c94-792f08d7a1db tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:16.382274 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-39f0c23f-af1d-4a62-8c94-792f08d7a1db tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1368 microversion: 2.1 time: 0.310835 Jul 18 08:50:16.391482 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 253/489] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:16 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1368 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:16.402403 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1768531053", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-239426097", "security_groups": [{"name": "tempest-secgroup-smoke-1587307711"}], "block_device_mapping_v2": [{"uuid": "327b57f0-d072-4fa6-a8d8-99ce827a3c2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "14ef1bb9-db47-48f8-bf4d-197c43ed89fa"}]}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:16.445565 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-527b46e2-a93c-42b1-b162-e29c4291b81f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:16.450509 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=4 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:16.462560 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-527b46e2-a93c-42b1-b162-e29c4291b81f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.285044 Jul 18 08:50:16.463850 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 237/490] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:16 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:16.582794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.network.neutron [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] validate_networks() for [('14ef1bb9-db47-48f8-bf4d-197c43ed89fa', None, None, None, None, None)] {{(pid=124894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:50:16.996388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Flavor limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:50:16.996808 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Image limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:50:16.997282 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Flavor pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:50:16.997684 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Image pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:50:16.998095 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:50:17.007364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:17.007847 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:17.008637 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:17.009065 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:17.027044 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Getting quotas for project d37f9217ffb94786830f0f6c5970b762. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:50:17.031032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Getting quotas for user ba4946e9565f4a608dd04fbc4de18dad and project d37f9217ffb94786830f0f6c5970b762. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:50:17.091210 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Going to run 1 instances... {{(pid=124894) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:50:17.093254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='327b57f0-d072-4fa6-a8d8-99ce827a3c2d',volume_size=None,volume_type=None)] {{(pid=124894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:50:17.414256 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b5732486-4e92-4917-af4a-68b48a037f73 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:17.414832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b5732486-4e92-4917-af4a-68b48a037f73 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:17.422840 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b5732486-4e92-4917-af4a-68b48a037f73 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:17.423289 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b5732486-4e92-4917-af4a-68b48a037f73 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:17.424104 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b5732486-4e92-4917-af4a-68b48a037f73 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:17.424543 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b5732486-4e92-4917-af4a-68b48a037f73 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:17.595203 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b5732486-4e92-4917-af4a-68b48a037f73 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:17.602690 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b5732486-4e92-4917-af4a-68b48a037f73 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1368 microversion: 2.1 time: 0.193058 Jul 18 08:50:17.625378 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 238/491] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:17 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:17.625378 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7d4b8e6f-2cd2-4cea-bae5-b613ea2911ac tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:17.625378 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7d4b8e6f-2cd2-4cea-bae5-b613ea2911ac tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:17.625378 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7d4b8e6f-2cd2-4cea-bae5-b613ea2911ac tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:17.626040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7d4b8e6f-2cd2-4cea-bae5-b613ea2911ac tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:17.626040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7d4b8e6f-2cd2-4cea-bae5-b613ea2911ac tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:17.626040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7d4b8e6f-2cd2-4cea-bae5-b613ea2911ac tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:17.755715 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7d4b8e6f-2cd2-4cea-bae5-b613ea2911ac tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:17.763226 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7d4b8e6f-2cd2-4cea-bae5-b613ea2911ac tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.158872 Jul 18 08:50:17.763848 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 239/492] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:17 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:17.980353 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f514c2b9-4f92-4352-bf43-6c15797b9237 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.586295 Jul 18 08:50:17.981495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 254/493] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:50:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:50:17.992024 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-541dca2f-fded-46b1-a11d-d81f96eec151 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:17.993434 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-541dca2f-fded-46b1-a11d-d81f96eec151 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:18.073407 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-541dca2f-fded-46b1-a11d-d81f96eec151 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:18.082114 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-541dca2f-fded-46b1-a11d-d81f96eec151 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1094 microversion: 2.1 time: 0.094075 Jul 18 08:50:18.082963 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 240/494] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:17 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:18.623023 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6df6980c-f073-4dc1-850a-12350fc33629 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:18.623819 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6df6980c-f073-4dc1-850a-12350fc33629 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:18.632706 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6df6980c-f073-4dc1-850a-12350fc33629 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:18.633252 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6df6980c-f073-4dc1-850a-12350fc33629 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:18.634085 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6df6980c-f073-4dc1-850a-12350fc33629 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:18.634567 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6df6980c-f073-4dc1-850a-12350fc33629 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:18.780740 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6df6980c-f073-4dc1-850a-12350fc33629 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:18.781614 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-03c14daf-1e16-4e32-9276-1f29a00a254a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:18.782306 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-03c14daf-1e16-4e32-9276-1f29a00a254a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:18.789026 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6df6980c-f073-4dc1-850a-12350fc33629 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1368 microversion: 2.1 time: 0.171668 Jul 18 08:50:18.789612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 255/495] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:18 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:18.799224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-03c14daf-1e16-4e32-9276-1f29a00a254a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:18.799224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-03c14daf-1e16-4e32-9276-1f29a00a254a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:18.799224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-03c14daf-1e16-4e32-9276-1f29a00a254a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:18.799224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-03c14daf-1e16-4e32-9276-1f29a00a254a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:18.940291 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-03c14daf-1e16-4e32-9276-1f29a00a254a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:18.953675 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-03c14daf-1e16-4e32-9276-1f29a00a254a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.176920 Jul 18 08:50:18.955397 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 241/496] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:18 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:19.102318 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b0e42080-2271-472a-9e3c-f5e6b3293e68 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:19.102937 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b0e42080-2271-472a-9e3c-f5e6b3293e68 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:19.110243 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b0e42080-2271-472a-9e3c-f5e6b3293e68 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:19.110857 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b0e42080-2271-472a-9e3c-f5e6b3293e68 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:19.115938 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b0e42080-2271-472a-9e3c-f5e6b3293e68 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:19.115938 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b0e42080-2271-472a-9e3c-f5e6b3293e68 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:19.141662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:19.197062 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b0e42080-2271-472a-9e3c-f5e6b3293e68 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:19.205704 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b0e42080-2271-472a-9e3c-f5e6b3293e68 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1144 microversion: 2.1 time: 0.107175 Jul 18 08:50:19.206391 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 256/497] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:19 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1144 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:19.752341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7332961c-b733-43ca-85a6-5b3bb9fc600c tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:19.752964 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7332961c-b733-43ca-85a6-5b3bb9fc600c tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:19.761281 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7332961c-b733-43ca-85a6-5b3bb9fc600c tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:19.762032 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7332961c-b733-43ca-85a6-5b3bb9fc600c tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:19.763361 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7332961c-b733-43ca-85a6-5b3bb9fc600c tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:19.764122 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7332961c-b733-43ca-85a6-5b3bb9fc600c tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:19.806882 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-285c824d-c78f-451b-ad5b-373af78a1fb8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:19.807603 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-285c824d-c78f-451b-ad5b-373af78a1fb8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:19.814915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-285c824d-c78f-451b-ad5b-373af78a1fb8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:19.815368 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-285c824d-c78f-451b-ad5b-373af78a1fb8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:19.816186 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-285c824d-c78f-451b-ad5b-373af78a1fb8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:19.816632 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-285c824d-c78f-451b-ad5b-373af78a1fb8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:19.924717 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7332961c-b733-43ca-85a6-5b3bb9fc600c tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:19.939928 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7332961c-b733-43ca-85a6-5b3bb9fc600c tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1595 microversion: 2.1 time: 0.190909 Jul 18 08:50:19.941001 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 242/498] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:19 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1595 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:19.975376 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a68eff46-ffe9-4747-ab4a-c70c0e2fa8d1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:19.977071 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a68eff46-ffe9-4747-ab4a-c70c0e2fa8d1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:19.984066 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-285c824d-c78f-451b-ad5b-373af78a1fb8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:19.992366 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-285c824d-c78f-451b-ad5b-373af78a1fb8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1368 microversion: 2.1 time: 0.188200 Jul 18 08:50:19.999314 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 257/499] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:19 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:20.003515 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a68eff46-ffe9-4747-ab4a-c70c0e2fa8d1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:20.004012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a68eff46-ffe9-4747-ab4a-c70c0e2fa8d1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:20.004802 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a68eff46-ffe9-4747-ab4a-c70c0e2fa8d1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:20.005236 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a68eff46-ffe9-4747-ab4a-c70c0e2fa8d1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:20.154711 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a68eff46-ffe9-4747-ab4a-c70c0e2fa8d1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:20.163038 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a68eff46-ffe9-4747-ab4a-c70c0e2fa8d1 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.194850 Jul 18 08:50:20.163710 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 243/500] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:19 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:20.228500 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-618539df-f257-4b29-a864-674d803d5187 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:20.229120 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-618539df-f257-4b29-a864-674d803d5187 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:20.236683 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-618539df-f257-4b29-a864-674d803d5187 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:20.237143 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-618539df-f257-4b29-a864-674d803d5187 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:20.237937 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-618539df-f257-4b29-a864-674d803d5187 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:20.238383 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-618539df-f257-4b29-a864-674d803d5187 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:20.309601 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-618539df-f257-4b29-a864-674d803d5187 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:20.319487 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-618539df-f257-4b29-a864-674d803d5187 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1192 microversion: 2.1 time: 0.094758 Jul 18 08:50:20.330285 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 258/501] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:20 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:21.016037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5b9f5974-2b87-4693-a330-749eee6de923 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:21.016673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5b9f5974-2b87-4693-a330-749eee6de923 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:21.024929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b9f5974-2b87-4693-a330-749eee6de923 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:21.025449 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b9f5974-2b87-4693-a330-749eee6de923 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:21.026327 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b9f5974-2b87-4693-a330-749eee6de923 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:21.027093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b9f5974-2b87-4693-a330-749eee6de923 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:21.187517 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9ab09997-e37b-482e-b66f-37251f6efe7b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:21.191319 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9ab09997-e37b-482e-b66f-37251f6efe7b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:21.197885 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5b9f5974-2b87-4693-a330-749eee6de923 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:21.205348 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9ab09997-e37b-482e-b66f-37251f6efe7b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:21.206743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9ab09997-e37b-482e-b66f-37251f6efe7b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:21.208044 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9ab09997-e37b-482e-b66f-37251f6efe7b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:21.208534 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9ab09997-e37b-482e-b66f-37251f6efe7b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:21.209254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5b9f5974-2b87-4693-a330-749eee6de923 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1368 microversion: 2.1 time: 0.199077 Jul 18 08:50:21.210105 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 244/502] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:21 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:21.338398 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-eabbb08d-26f6-4306-85c3-48495914f40c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:21.339020 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-eabbb08d-26f6-4306-85c3-48495914f40c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:21.345985 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eabbb08d-26f6-4306-85c3-48495914f40c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:21.346442 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eabbb08d-26f6-4306-85c3-48495914f40c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:21.347215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eabbb08d-26f6-4306-85c3-48495914f40c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:21.347652 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eabbb08d-26f6-4306-85c3-48495914f40c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:21.423042 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-eabbb08d-26f6-4306-85c3-48495914f40c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:21.439010 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-eabbb08d-26f6-4306-85c3-48495914f40c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1210 microversion: 2.1 time: 0.104312 Jul 18 08:50:21.449442 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 245/503] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:21 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:21.841378 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9ab09997-e37b-482e-b66f-37251f6efe7b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:21.854887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9ab09997-e37b-482e-b66f-37251f6efe7b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.676791 Jul 18 08:50:21.856094 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 259/504] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:21 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:22.239314 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7ca2f94b-3d5b-4b52-aa91-b1f3f06bf9c6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:22.240496 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7ca2f94b-3d5b-4b52-aa91-b1f3f06bf9c6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:22.253758 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ca2f94b-3d5b-4b52-aa91-b1f3f06bf9c6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:22.254672 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ca2f94b-3d5b-4b52-aa91-b1f3f06bf9c6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:22.256105 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ca2f94b-3d5b-4b52-aa91-b1f3f06bf9c6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:22.256904 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ca2f94b-3d5b-4b52-aa91-b1f3f06bf9c6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:22.336800 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-cdd6b431-d293-46ae-ad75-17b07b8a07d5 req-fb4b9a44-debb-47c1-b01d-827c3181e49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b503f6b2-890d-41b0-9323-5af163d8a016", "name": "network-vif-plugged", "status": "completed", "tag": "c9bbf27b-9770-4d9c-8c89-bef4da1b48d3"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:22.350335 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-cdd6b431-d293-46ae-ad75-17b07b8a07d5 req-fb4b9a44-debb-47c1-b01d-827c3181e49a service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:22.352875 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-cdd6b431-d293-46ae-ad75-17b07b8a07d5 req-fb4b9a44-debb-47c1-b01d-827c3181e49a service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:22.370232 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-cdd6b431-d293-46ae-ad75-17b07b8a07d5 req-fb4b9a44-debb-47c1-b01d-827c3181e49a service nova] Creating event network-vif-plugged:c9bbf27b-9770-4d9c-8c89-bef4da1b48d3 for instance b503f6b2-890d-41b0-9323-5af163d8a016 on hv-cinder-85014 Jul 18 08:50:22.377364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-cdd6b431-d293-46ae-ad75-17b07b8a07d5 req-fb4b9a44-debb-47c1-b01d-827c3181e49a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044422 Jul 18 08:50:22.377966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 260/505] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:22.431974 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7ca2f94b-3d5b-4b52-aa91-b1f3f06bf9c6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:22.438291 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:22.447817 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7ca2f94b-3d5b-4b52-aa91-b1f3f06bf9c6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1368 microversion: 2.1 time: 0.215430 Jul 18 08:50:22.459662 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 246/506] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:22 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:22.459865 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-28373a96-2df5-4c1c-a8aa-92b9ad493ada tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:22.460667 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-28373a96-2df5-4c1c-a8aa-92b9ad493ada tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:22.477570 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-28373a96-2df5-4c1c-a8aa-92b9ad493ada tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:22.477904 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-28373a96-2df5-4c1c-a8aa-92b9ad493ada tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:22.481722 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-28373a96-2df5-4c1c-a8aa-92b9ad493ada tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:22.482560 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-28373a96-2df5-4c1c-a8aa-92b9ad493ada tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:22.798540 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-28373a96-2df5-4c1c-a8aa-92b9ad493ada tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:22.811563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-28373a96-2df5-4c1c-a8aa-92b9ad493ada tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.357704 Jul 18 08:50:22.824263 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 261/507] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:22 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:22.879068 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-be120906-7b1b-421f-adb2-f9632eb3c1ab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:22.880005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-be120906-7b1b-421f-adb2-f9632eb3c1ab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:22.889605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be120906-7b1b-421f-adb2-f9632eb3c1ab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:22.890142 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be120906-7b1b-421f-adb2-f9632eb3c1ab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:22.891225 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be120906-7b1b-421f-adb2-f9632eb3c1ab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:22.891786 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be120906-7b1b-421f-adb2-f9632eb3c1ab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:23.053918 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-be120906-7b1b-421f-adb2-f9632eb3c1ab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:23.075461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-be120906-7b1b-421f-adb2-f9632eb3c1ab tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.200608 Jul 18 08:50:23.076098 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 247/508] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:22 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:23.477255 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3d12c973-1016-4e12-a644-e0b88242804f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:23.477926 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-3d12c973-1016-4e12-a644-e0b88242804f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:23.485528 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3d12c973-1016-4e12-a644-e0b88242804f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:23.485988 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3d12c973-1016-4e12-a644-e0b88242804f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:23.486749 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3d12c973-1016-4e12-a644-e0b88242804f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:23.487182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3d12c973-1016-4e12-a644-e0b88242804f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:23.806144 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-3d12c973-1016-4e12-a644-e0b88242804f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:23.817854 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-3d12c973-1016-4e12-a644-e0b88242804f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1368 microversion: 2.1 time: 0.344336 Jul 18 08:50:23.818782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 262/509] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:23 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1368 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:23.834001 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-63a75367-ca70-4608-ab8d-8f5704c1afeb tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:23.835799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-63a75367-ca70-4608-ab8d-8f5704c1afeb tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:23.847700 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-63a75367-ca70-4608-ab8d-8f5704c1afeb tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:23.848555 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-63a75367-ca70-4608-ab8d-8f5704c1afeb tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:23.849584 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-63a75367-ca70-4608-ab8d-8f5704c1afeb tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:23.850319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-63a75367-ca70-4608-ab8d-8f5704c1afeb tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:24.039612 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-63a75367-ca70-4608-ab8d-8f5704c1afeb tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:24.053775 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-31fcdcea-e2ac-4771-8a9f-d0d2d063d5e1 req-3287cb35-62ac-4d8a-8b0f-9643f7a253b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb91124-0b62-4d50-985e-b3e73389fe4e", "tag": "2b862c2d-6596-4494-b33e-d23be8bd6301"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:24.054220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-63a75367-ca70-4608-ab8d-8f5704c1afeb tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.223793 Jul 18 08:50:24.055431 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 248/510] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:23 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:24.071507 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-31fcdcea-e2ac-4771-8a9f-d0d2d063d5e1 req-3287cb35-62ac-4d8a-8b0f-9643f7a253b7 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:24.072170 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-31fcdcea-e2ac-4771-8a9f-d0d2d063d5e1 req-3287cb35-62ac-4d8a-8b0f-9643f7a253b7 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:24.085146 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-31fcdcea-e2ac-4771-8a9f-d0d2d063d5e1 req-3287cb35-62ac-4d8a-8b0f-9643f7a253b7 service nova] Creating event network-changed:2b862c2d-6596-4494-b33e-d23be8bd6301 for instance 1bb91124-0b62-4d50-985e-b3e73389fe4e on hv-cinder-85014 Jul 18 08:50:24.092508 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-31fcdcea-e2ac-4771-8a9f-d0d2d063d5e1 req-3287cb35-62ac-4d8a-8b0f-9643f7a253b7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042072 Jul 18 08:50:24.093135 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 263/511] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:50:24.107172 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d455d1f2-5eb2-4c99-84dc-b255d4b5d248 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:24.109260 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d455d1f2-5eb2-4c99-84dc-b255d4b5d248 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:24.123854 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d455d1f2-5eb2-4c99-84dc-b255d4b5d248 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:24.124934 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d455d1f2-5eb2-4c99-84dc-b255d4b5d248 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:24.126002 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d455d1f2-5eb2-4c99-84dc-b255d4b5d248 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:24.126640 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d455d1f2-5eb2-4c99-84dc-b255d4b5d248 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:24.445791 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d455d1f2-5eb2-4c99-84dc-b255d4b5d248 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:24.456529 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d455d1f2-5eb2-4c99-84dc-b255d4b5d248 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.365395 Jul 18 08:50:24.457257 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 249/512] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:24 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:24.847952 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-652797dd-ffb1-480f-bdbb-9783e442ae15 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:24.848724 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-652797dd-ffb1-480f-bdbb-9783e442ae15 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:24.857033 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-652797dd-ffb1-480f-bdbb-9783e442ae15 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:24.857488 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-652797dd-ffb1-480f-bdbb-9783e442ae15 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:24.858265 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-652797dd-ffb1-480f-bdbb-9783e442ae15 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:24.858697 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-652797dd-ffb1-480f-bdbb-9783e442ae15 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:25.072722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2edb7051-a701-463f-805f-21c604f2956a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:25.074851 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2edb7051-a701-463f-805f-21c604f2956a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:25.083893 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2edb7051-a701-463f-805f-21c604f2956a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:25.085350 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2edb7051-a701-463f-805f-21c604f2956a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:25.087157 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2edb7051-a701-463f-805f-21c604f2956a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:25.087944 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2edb7051-a701-463f-805f-21c604f2956a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:25.124430 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-652797dd-ffb1-480f-bdbb-9783e442ae15 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:25.134182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-652797dd-ffb1-480f-bdbb-9783e442ae15 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1559 microversion: 2.1 time: 0.291564 Jul 18 08:50:25.141151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 264/513] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:24 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1559 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:25.152563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5d41b316-f4d5-48c2-9b62-d6fdb1beeefb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:25.153510 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5d41b316-f4d5-48c2-9b62-d6fdb1beeefb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:25.175977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5d41b316-f4d5-48c2-9b62-d6fdb1beeefb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:25.177702 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5d41b316-f4d5-48c2-9b62-d6fdb1beeefb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:25.178722 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5d41b316-f4d5-48c2-9b62-d6fdb1beeefb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:25.179395 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5d41b316-f4d5-48c2-9b62-d6fdb1beeefb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:25.292074 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5d41b316-f4d5-48c2-9b62-d6fdb1beeefb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143826 Jul 18 08:50:25.293936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 265/514] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 08:50:25 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:50:25.422168 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2edb7051-a701-463f-805f-21c604f2956a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:25.436337 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2edb7051-a701-463f-805f-21c604f2956a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.368188 Jul 18 08:50:25.437276 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 250/515] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:25 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:25.480743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d68db5b4-52d3-4111-951c-2f48bcbbf31f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:25.482214 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d68db5b4-52d3-4111-951c-2f48bcbbf31f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:25.491955 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d68db5b4-52d3-4111-951c-2f48bcbbf31f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:25.493376 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d68db5b4-52d3-4111-951c-2f48bcbbf31f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:25.494858 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d68db5b4-52d3-4111-951c-2f48bcbbf31f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:25.496455 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d68db5b4-52d3-4111-951c-2f48bcbbf31f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:26.063620 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d68db5b4-52d3-4111-951c-2f48bcbbf31f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:26.072578 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d68db5b4-52d3-4111-951c-2f48bcbbf31f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.600053 Jul 18 08:50:26.083005 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 266/516] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:25 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:26.148206 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-be7c85fd-f607-4be8-b55e-b26fd55709f2 req-edbeb442-ebe9-4156-b158-fdd632592bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c53c5dca-7e2b-4a47-9a81-7888b20e67fe", "tag": "31760e24-104d-4678-9e4f-2ba58cdc21a9"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:26.158908 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-be7c85fd-f607-4be8-b55e-b26fd55709f2 req-edbeb442-ebe9-4156-b158-fdd632592bb6 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:26.159797 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-be7c85fd-f607-4be8-b55e-b26fd55709f2 req-edbeb442-ebe9-4156-b158-fdd632592bb6 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:26.173859 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-be7c85fd-f607-4be8-b55e-b26fd55709f2 req-edbeb442-ebe9-4156-b158-fdd632592bb6 service nova] Creating event network-changed:31760e24-104d-4678-9e4f-2ba58cdc21a9 for instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe on hv-cinder-85014 Jul 18 08:50:26.179714 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-be7c85fd-f607-4be8-b55e-b26fd55709f2 req-edbeb442-ebe9-4156-b158-fdd632592bb6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035116 Jul 18 08:50:26.180679 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 251/517] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:26.454854 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-66995108-630a-4a2d-ab49-09a43a9530a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:26.455772 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-66995108-630a-4a2d-ab49-09a43a9530a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:26.463456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66995108-630a-4a2d-ab49-09a43a9530a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:26.464647 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66995108-630a-4a2d-ab49-09a43a9530a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:26.465317 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66995108-630a-4a2d-ab49-09a43a9530a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:26.465761 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66995108-630a-4a2d-ab49-09a43a9530a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:26.814321 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-66995108-630a-4a2d-ab49-09a43a9530a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:26.822328 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-66995108-630a-4a2d-ab49-09a43a9530a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.372317 Jul 18 08:50:26.822920 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 267/518] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:26 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:27.091142 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-27477e1a-80e1-4a3d-9e3d-1c1b6e368432 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:27.091873 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-27477e1a-80e1-4a3d-9e3d-1c1b6e368432 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:27.098390 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-27477e1a-80e1-4a3d-9e3d-1c1b6e368432 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:27.098837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-27477e1a-80e1-4a3d-9e3d-1c1b6e368432 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:27.099634 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-27477e1a-80e1-4a3d-9e3d-1c1b6e368432 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:27.100100 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-27477e1a-80e1-4a3d-9e3d-1c1b6e368432 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:27.250117 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-27477e1a-80e1-4a3d-9e3d-1c1b6e368432 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:27.261799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-27477e1a-80e1-4a3d-9e3d-1c1b6e368432 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.174206 Jul 18 08:50:27.274200 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 252/519] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:27 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:27.796336 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-066f0ae3-8044-43f6-b246-eb3b9f381784 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-770594222"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:27.796336 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-066f0ae3-8044-43f6-b246-eb3b9f381784 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:27.798135 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=6 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:27.798887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=14 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:27.802934 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-066f0ae3-8044-43f6-b246-eb3b9f381784 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:27.803390 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-066f0ae3-8044-43f6-b246-eb3b9f381784 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:27.804224 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-066f0ae3-8044-43f6-b246-eb3b9f381784 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:27.804666 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-066f0ae3-8044-43f6-b246-eb3b9f381784 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:27.849376 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-fadd3ed3-624a-4f6a-8edf-652840bb5ed3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:27.850626 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-fadd3ed3-624a-4f6a-8edf-652840bb5ed3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:27.863447 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fadd3ed3-624a-4f6a-8edf-652840bb5ed3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:27.864169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fadd3ed3-624a-4f6a-8edf-652840bb5ed3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:27.865206 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fadd3ed3-624a-4f6a-8edf-652840bb5ed3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:27.865754 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fadd3ed3-624a-4f6a-8edf-652840bb5ed3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:27.965599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.network.security_group_api [None req-066f0ae3-8044-43f6-b246-eb3b9f381784 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Adding security group 70dff4e9-152c-49aa-8332-cd8d6ea76c8f to port 2b862c2d-6596-4494-b33e-d23be8bd6301 Jul 18 08:50:28.028663 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-fadd3ed3-624a-4f6a-8edf-652840bb5ed3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:28.037515 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-fadd3ed3-624a-4f6a-8edf-652840bb5ed3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.193426 Jul 18 08:50:28.038570 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 253/520] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:27 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:28.216463 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-2d625a6a-7904-404b-8fd1-d82d5b47341a req-cef059c3-c398-4571-8965-9d690f40455e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b503f6b2-890d-41b0-9323-5af163d8a016", "tag": "c9bbf27b-9770-4d9c-8c89-bef4da1b48d3"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:28.220705 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:28.227149 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-2d625a6a-7904-404b-8fd1-d82d5b47341a req-cef059c3-c398-4571-8965-9d690f40455e service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:28.227813 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-2d625a6a-7904-404b-8fd1-d82d5b47341a req-cef059c3-c398-4571-8965-9d690f40455e service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:28.240892 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-2d625a6a-7904-404b-8fd1-d82d5b47341a req-cef059c3-c398-4571-8965-9d690f40455e service nova] Creating event network-changed:c9bbf27b-9770-4d9c-8c89-bef4da1b48d3 for instance b503f6b2-890d-41b0-9323-5af163d8a016 on hv-cinder-85014 Jul 18 08:50:28.246648 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-2d625a6a-7904-404b-8fd1-d82d5b47341a req-cef059c3-c398-4571-8965-9d690f40455e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034668 Jul 18 08:50:28.247516 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 254/521] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:28.282837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e1d8cc67-b9a4-4062-9590-f258d1385838 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:28.284310 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e1d8cc67-b9a4-4062-9590-f258d1385838 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:28.293914 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e1d8cc67-b9a4-4062-9590-f258d1385838 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:28.294313 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e1d8cc67-b9a4-4062-9590-f258d1385838 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:28.295346 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e1d8cc67-b9a4-4062-9590-f258d1385838 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:28.295819 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e1d8cc67-b9a4-4062-9590-f258d1385838 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:28.448065 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e1d8cc67-b9a4-4062-9590-f258d1385838 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:28.457792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e1d8cc67-b9a4-4062-9590-f258d1385838 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.179675 Jul 18 08:50:28.458867 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 255/522] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:28 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:28.537894 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-066f0ae3-8044-43f6-b246-eb3b9f381784 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "POST /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/action" status: 202 len: 0 microversion: 2.1 time: 0.748652 Jul 18 08:50:28.539391 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 268/523] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:50:27 2022] POST /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/action => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:50:28.561417 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-128b2fff-cad5-4dcb-9f51-a25be53e6441 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:28.562648 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-128b2fff-cad5-4dcb-9f51-a25be53e6441 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:28.576971 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-128b2fff-cad5-4dcb-9f51-a25be53e6441 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:28.578317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-128b2fff-cad5-4dcb-9f51-a25be53e6441 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:28.580265 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-128b2fff-cad5-4dcb-9f51-a25be53e6441 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:28.581350 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-128b2fff-cad5-4dcb-9f51-a25be53e6441 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:28.783476 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-128b2fff-cad5-4dcb-9f51-a25be53e6441 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:28.806096 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-128b2fff-cad5-4dcb-9f51-a25be53e6441 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1759 microversion: 2.1 time: 0.243979 Jul 18 08:50:28.806096 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 256/524] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:28 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1759 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:29.056716 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-97d7447f-e3cc-411a-b25c-f8311f3ff68f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:29.057344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-97d7447f-e3cc-411a-b25c-f8311f3ff68f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:29.066446 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-97d7447f-e3cc-411a-b25c-f8311f3ff68f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:29.066908 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-97d7447f-e3cc-411a-b25c-f8311f3ff68f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:29.067968 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-97d7447f-e3cc-411a-b25c-f8311f3ff68f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:29.068415 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-97d7447f-e3cc-411a-b25c-f8311f3ff68f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:29.245966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-97d7447f-e3cc-411a-b25c-f8311f3ff68f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:29.255999 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-97d7447f-e3cc-411a-b25c-f8311f3ff68f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.203596 Jul 18 08:50:29.256963 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 269/525] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:29 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:29.477156 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-67802d99-74ea-4e03-bf48-17c038020646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:29.477863 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-67802d99-74ea-4e03-bf48-17c038020646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:29.485703 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-67802d99-74ea-4e03-bf48-17c038020646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:29.486156 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-67802d99-74ea-4e03-bf48-17c038020646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:29.486940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-67802d99-74ea-4e03-bf48-17c038020646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:29.487390 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-67802d99-74ea-4e03-bf48-17c038020646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:29.627739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-67802d99-74ea-4e03-bf48-17c038020646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:29.636619 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-67802d99-74ea-4e03-bf48-17c038020646 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.162751 Jul 18 08:50:29.637217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 257/526] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:29 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:30.272472 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-c976bdac-1cbe-4296-b8f4-d27e32a2b5c3 req-0e86cbca-a9ec-4c43-980d-8c874d5f3d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb91124-0b62-4d50-985e-b3e73389fe4e", "tag": "2b862c2d-6596-4494-b33e-d23be8bd6301"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:30.273008 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7b215f19-fbbf-4d58-a0da-683f83c9152f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:30.273140 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7b215f19-fbbf-4d58-a0da-683f83c9152f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:30.279594 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7b215f19-fbbf-4d58-a0da-683f83c9152f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:30.280068 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7b215f19-fbbf-4d58-a0da-683f83c9152f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:30.280844 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7b215f19-fbbf-4d58-a0da-683f83c9152f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:30.281310 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7b215f19-fbbf-4d58-a0da-683f83c9152f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:30.281659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-c976bdac-1cbe-4296-b8f4-d27e32a2b5c3 req-0e86cbca-a9ec-4c43-980d-8c874d5f3d25 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:30.282178 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-c976bdac-1cbe-4296-b8f4-d27e32a2b5c3 req-0e86cbca-a9ec-4c43-980d-8c874d5f3d25 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:30.293673 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-c976bdac-1cbe-4296-b8f4-d27e32a2b5c3 req-0e86cbca-a9ec-4c43-980d-8c874d5f3d25 service nova] Creating event network-changed:2b862c2d-6596-4494-b33e-d23be8bd6301 for instance 1bb91124-0b62-4d50-985e-b3e73389fe4e on hv-cinder-85014 Jul 18 08:50:30.298887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-c976bdac-1cbe-4296-b8f4-d27e32a2b5c3 req-0e86cbca-a9ec-4c43-980d-8c874d5f3d25 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030480 Jul 18 08:50:30.299619 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 270/527] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:30.423618 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7b215f19-fbbf-4d58-a0da-683f83c9152f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:30.431525 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7b215f19-fbbf-4d58-a0da-683f83c9152f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.162819 Jul 18 08:50:30.432157 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 258/528] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:30 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:30.654596 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-87b444e4-3eab-4051-9eb8-be14e36f778a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:30.655288 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-87b444e4-3eab-4051-9eb8-be14e36f778a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:30.661675 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-87b444e4-3eab-4051-9eb8-be14e36f778a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:30.662131 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-87b444e4-3eab-4051-9eb8-be14e36f778a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:30.662938 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-87b444e4-3eab-4051-9eb8-be14e36f778a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:30.663383 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-87b444e4-3eab-4051-9eb8-be14e36f778a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:30.806354 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-87b444e4-3eab-4051-9eb8-be14e36f778a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:30.814493 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-87b444e4-3eab-4051-9eb8-be14e36f778a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.164278 Jul 18 08:50:30.815061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 271/529] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:30 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:31.451249 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-95cab3e7-64ff-401b-b2d3-06a8ebeafae6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:31.451921 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-95cab3e7-64ff-401b-b2d3-06a8ebeafae6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:31.460138 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-95cab3e7-64ff-401b-b2d3-06a8ebeafae6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:31.461180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-95cab3e7-64ff-401b-b2d3-06a8ebeafae6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:31.462039 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-95cab3e7-64ff-401b-b2d3-06a8ebeafae6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:31.462483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-95cab3e7-64ff-401b-b2d3-06a8ebeafae6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:31.626295 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-95cab3e7-64ff-401b-b2d3-06a8ebeafae6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:31.634525 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-95cab3e7-64ff-401b-b2d3-06a8ebeafae6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.188612 Jul 18 08:50:31.635115 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 259/530] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:31 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:31.832076 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-82b07f73-61a9-4bc4-b47c-1c13aa54ee19 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:31.832629 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-82b07f73-61a9-4bc4-b47c-1c13aa54ee19 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:31.840458 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-82b07f73-61a9-4bc4-b47c-1c13aa54ee19 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:31.840916 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-82b07f73-61a9-4bc4-b47c-1c13aa54ee19 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:31.841690 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-82b07f73-61a9-4bc4-b47c-1c13aa54ee19 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:31.842154 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-82b07f73-61a9-4bc4-b47c-1c13aa54ee19 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:32.022924 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-82b07f73-61a9-4bc4-b47c-1c13aa54ee19 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:32.032037 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-82b07f73-61a9-4bc4-b47c-1c13aa54ee19 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.204093 Jul 18 08:50:32.032608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 272/531] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:31 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:32.653070 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-cde2a0ec-d605-4d6e-83f1-6a5edd94972a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:32.653678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-cde2a0ec-d605-4d6e-83f1-6a5edd94972a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:32.661701 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cde2a0ec-d605-4d6e-83f1-6a5edd94972a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:32.662150 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cde2a0ec-d605-4d6e-83f1-6a5edd94972a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:32.662919 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cde2a0ec-d605-4d6e-83f1-6a5edd94972a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:32.663353 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cde2a0ec-d605-4d6e-83f1-6a5edd94972a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:32.804846 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-cde2a0ec-d605-4d6e-83f1-6a5edd94972a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:32.813791 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-cde2a0ec-d605-4d6e-83f1-6a5edd94972a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.164592 Jul 18 08:50:32.814384 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 260/532] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:32 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:33.049706 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d280535a-3b2a-40f6-9b90-588d8e7ceb87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:33.050314 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d280535a-3b2a-40f6-9b90-588d8e7ceb87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:33.058024 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d280535a-3b2a-40f6-9b90-588d8e7ceb87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:33.058476 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d280535a-3b2a-40f6-9b90-588d8e7ceb87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:33.059373 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d280535a-3b2a-40f6-9b90-588d8e7ceb87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:33.060586 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d280535a-3b2a-40f6-9b90-588d8e7ceb87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:33.193348 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d280535a-3b2a-40f6-9b90-588d8e7ceb87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:33.201588 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d280535a-3b2a-40f6-9b90-588d8e7ceb87 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.156944 Jul 18 08:50:33.202225 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 273/533] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:33 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:33.832054 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6603e36c-fb62-473a-b74d-67776ff92f46 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:33.832902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-6603e36c-fb62-473a-b74d-67776ff92f46 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:33.842826 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6603e36c-fb62-473a-b74d-67776ff92f46 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:33.843813 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6603e36c-fb62-473a-b74d-67776ff92f46 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:33.845018 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6603e36c-fb62-473a-b74d-67776ff92f46 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:33.845559 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6603e36c-fb62-473a-b74d-67776ff92f46 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:33.986861 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6603e36c-fb62-473a-b74d-67776ff92f46 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:33.994663 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-6603e36c-fb62-473a-b74d-67776ff92f46 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.167659 Jul 18 08:50:33.995230 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 261/534] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:33 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:34.219485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e4f2b297-b98a-470a-9b5f-ff0cfb4e495c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:34.220143 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e4f2b297-b98a-470a-9b5f-ff0cfb4e495c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:34.227010 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4f2b297-b98a-470a-9b5f-ff0cfb4e495c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:34.227214 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4f2b297-b98a-470a-9b5f-ff0cfb4e495c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:34.227946 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4f2b297-b98a-470a-9b5f-ff0cfb4e495c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:34.228384 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4f2b297-b98a-470a-9b5f-ff0cfb4e495c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:34.376543 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e4f2b297-b98a-470a-9b5f-ff0cfb4e495c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:34.387131 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e4f2b297-b98a-470a-9b5f-ff0cfb4e495c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1734 microversion: 2.1 time: 0.171458 Jul 18 08:50:34.387846 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 274/535] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:34 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:35.015436 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8eb108b0-6a3f-47d1-93e8-9bdec5547d07 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:35.016055 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8eb108b0-6a3f-47d1-93e8-9bdec5547d07 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:35.025012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8eb108b0-6a3f-47d1-93e8-9bdec5547d07 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:35.025465 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8eb108b0-6a3f-47d1-93e8-9bdec5547d07 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:35.026244 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8eb108b0-6a3f-47d1-93e8-9bdec5547d07 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:35.026681 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8eb108b0-6a3f-47d1-93e8-9bdec5547d07 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:35.172048 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-8eb108b0-6a3f-47d1-93e8-9bdec5547d07 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:35.179994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8eb108b0-6a3f-47d1-93e8-9bdec5547d07 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.170896 Jul 18 08:50:35.180550 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 262/536] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:35 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:35.404640 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c288e60c-8b06-4ea6-b638-fdb85f1a37b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:35.405252 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c288e60c-8b06-4ea6-b638-fdb85f1a37b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:35.411719 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c288e60c-8b06-4ea6-b638-fdb85f1a37b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:35.412181 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c288e60c-8b06-4ea6-b638-fdb85f1a37b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:35.413038 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c288e60c-8b06-4ea6-b638-fdb85f1a37b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:35.413503 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c288e60c-8b06-4ea6-b638-fdb85f1a37b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:35.553993 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c288e60c-8b06-4ea6-b638-fdb85f1a37b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:35.556824 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=100 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:35.564311 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c288e60c-8b06-4ea6-b638-fdb85f1a37b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1714 microversion: 2.1 time: 0.163486 Jul 18 08:50:35.564885 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 275/537] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:35 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:35.678315 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3946599a-7b9e-4c0f-a725-a7d888b53713 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:35.678776 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3946599a-7b9e-4c0f-a725-a7d888b53713 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:35.685056 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3946599a-7b9e-4c0f-a725-a7d888b53713 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:35.685511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3946599a-7b9e-4c0f-a725-a7d888b53713 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:35.686285 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3946599a-7b9e-4c0f-a725-a7d888b53713 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:35.687445 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3946599a-7b9e-4c0f-a725-a7d888b53713 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:35.819504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-3946599a-7b9e-4c0f-a725-a7d888b53713 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] HTTP exception thrown: Cannot 'detach_volume' instance f3d75586-3142-49ba-b48b-9db088664de7 while it is in vm_state rescued Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3946599a-7b9e-4c0f-a725-a7d888b53713 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Request method failure captured: Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: DELETE /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments/d000b557-42bb-4852-9715-319381597a1e HTTP/1.1 Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3dPNM7loaJvWicYRxKNa0h2dELfsNCPBqGOVbM4VjyGgJ8YI3dpOKCRIG5ADhj0bk2Bwryh-K90h_Jd2S_dfzg6t89cOJ8oymbW0JrDzOPUwdA8pKjvNq7gMlvwLqdNYbV-dQFiRSW1qJ2dH3Y8KvvCxUHLV49BOovZ4stJNLcNu8 Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: c2f44b51cc624637bccd9ed1d3b1a769 Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:50:35.823254 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:50:35.825005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2f44b51cc624637bccd9ed1d3b1a769", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:50:35.825005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:50:35.825005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: c2f44b51cc624637bccd9ed1d3b1a769 Jul 18 08:50:35.825005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:50:35.825005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-ServerRescueNegativeTestJSON-220645641-project Jul 18 08:50:35.825005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:50:35.825005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:50:35.825005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 56b3d8d145d94b358c86345eb5c3b306 Jul 18 08:50:35.825005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-ServerRescueNegativeTestJSON-220645641-project Jul 18 08:50:35.825005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:50:35.825005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Cannot 'detach_volume' instance f3d75586-3142-49ba-b48b-9db088664de7 while it is in vm_state rescued Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'server_id': 'f3d75586-3142-49ba-b48b-9db088664de7', 'id': 'd000b557-42bb-4852-9715-319381597a1e'} Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f3d75586-3142-49ba-b48b-9db088664de7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:50:35.825870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f3d75586-3142-49ba-b48b-9db088664de7 while it is in vm_state rescued Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f3d75586-3142-49ba-b48b-9db088664de7 while it is in vm_state rescued Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:50:35.827611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3946599a-7b9e-4c0f-a725-a7d888b53713 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Returning 409 to user: Cannot 'detach_volume' instance f3d75586-3142-49ba-b48b-9db088664de7 while it is in vm_state rescued {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:50:35.829178 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3946599a-7b9e-4c0f-a725-a7d888b53713 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments/d000b557-42bb-4852-9715-319381597a1e" status: 409 len: 152 microversion: 2.1 time: 0.148370 Jul 18 08:50:35.829178 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 263/538] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:50:35 2022] DELETE /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments/d000b557-42bb-4852-9715-319381597a1e => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 08:50:35.832660 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d0a2a9c8-1f8d-488b-9058-f273c4770ea6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:35.833187 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d0a2a9c8-1f8d-488b-9058-f273c4770ea6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:35.839636 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d0a2a9c8-1f8d-488b-9058-f273c4770ea6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:35.840521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d0a2a9c8-1f8d-488b-9058-f273c4770ea6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:35.840761 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d0a2a9c8-1f8d-488b-9058-f273c4770ea6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:35.841191 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d0a2a9c8-1f8d-488b-9058-f273c4770ea6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:36.119613 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d0a2a9c8-1f8d-488b-9058-f273c4770ea6 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "POST /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/action" status: 202 len: 0 microversion: 2.1 time: 0.284626 Jul 18 08:50:36.119613 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 276/539] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:50:35 2022] POST /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 08:50:36.122469 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f07d3cae-459a-451c-ab98-00f90bea2e0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:36.123298 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f07d3cae-459a-451c-ab98-00f90bea2e0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:36.134128 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f07d3cae-459a-451c-ab98-00f90bea2e0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:36.134396 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f07d3cae-459a-451c-ab98-00f90bea2e0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:36.135082 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f07d3cae-459a-451c-ab98-00f90bea2e0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:36.135714 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f07d3cae-459a-451c-ab98-00f90bea2e0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:36.204682 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9ab78fc7-b89d-4a1c-897b-64a5b9eb5dba tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:36.205407 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9ab78fc7-b89d-4a1c-897b-64a5b9eb5dba tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:36.211955 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9ab78fc7-b89d-4a1c-897b-64a5b9eb5dba tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:36.218646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9ab78fc7-b89d-4a1c-897b-64a5b9eb5dba tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:36.218646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9ab78fc7-b89d-4a1c-897b-64a5b9eb5dba tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:36.218646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9ab78fc7-b89d-4a1c-897b-64a5b9eb5dba tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:36.288699 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f07d3cae-459a-451c-ab98-00f90bea2e0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:36.292534 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=100 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:36.301325 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f07d3cae-459a-451c-ab98-00f90bea2e0b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1722 microversion: 2.1 time: 0.182993 Jul 18 08:50:36.301920 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 264/540] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:36 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:36.375845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-46ac423e-cfc0-4e10-8d53-bfa506b035e2 req-7d09adc3-2d7d-46ad-94ea-0b7fc4c6d7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c53c5dca-7e2b-4a47-9a81-7888b20e67fe", "name": "network-vif-plugged", "status": "completed", "tag": "31760e24-104d-4678-9e4f-2ba58cdc21a9"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:36.385523 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-46ac423e-cfc0-4e10-8d53-bfa506b035e2 req-7d09adc3-2d7d-46ad-94ea-0b7fc4c6d7d7 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:36.385975 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-46ac423e-cfc0-4e10-8d53-bfa506b035e2 req-7d09adc3-2d7d-46ad-94ea-0b7fc4c6d7d7 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:36.400806 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-46ac423e-cfc0-4e10-8d53-bfa506b035e2 req-7d09adc3-2d7d-46ad-94ea-0b7fc4c6d7d7 service nova] Creating event network-vif-plugged:31760e24-104d-4678-9e4f-2ba58cdc21a9 for instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe on hv-cinder-85014 Jul 18 08:50:36.407036 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-46ac423e-cfc0-4e10-8d53-bfa506b035e2 req-7d09adc3-2d7d-46ad-94ea-0b7fc4c6d7d7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034983 Jul 18 08:50:36.407936 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 265/541] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:50:36.484516 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9ab78fc7-b89d-4a1c-897b-64a5b9eb5dba tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:36.493577 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9ab78fc7-b89d-4a1c-897b-64a5b9eb5dba tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.299767 Jul 18 08:50:36.494245 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 277/542] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:36 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:37.319616 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-19b30354-b415-4345-a1f2-632e4345fe74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:37.320331 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-19b30354-b415-4345-a1f2-632e4345fe74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:37.326683 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-19b30354-b415-4345-a1f2-632e4345fe74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:37.327139 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-19b30354-b415-4345-a1f2-632e4345fe74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:37.328799 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-19b30354-b415-4345-a1f2-632e4345fe74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:37.329237 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-19b30354-b415-4345-a1f2-632e4345fe74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:37.460583 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-19b30354-b415-4345-a1f2-632e4345fe74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:37.468728 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-19b30354-b415-4345-a1f2-632e4345fe74 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1722 microversion: 2.1 time: 0.154121 Jul 18 08:50:37.469324 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 266/543] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:37 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:37.512310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a6847a2b-924f-45e0-a6cb-0e7cca86d052 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:37.512940 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a6847a2b-924f-45e0-a6cb-0e7cca86d052 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:37.521023 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a6847a2b-924f-45e0-a6cb-0e7cca86d052 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:37.521474 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a6847a2b-924f-45e0-a6cb-0e7cca86d052 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:37.522256 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a6847a2b-924f-45e0-a6cb-0e7cca86d052 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:37.522698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a6847a2b-924f-45e0-a6cb-0e7cca86d052 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:37.666817 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a6847a2b-924f-45e0-a6cb-0e7cca86d052 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:37.674521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a6847a2b-924f-45e0-a6cb-0e7cca86d052 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.166635 Jul 18 08:50:37.675097 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 278/544] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:37 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:38.486603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-be7ee4e4-1675-4ae8-854b-22d341b3700c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:38.487223 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-be7ee4e4-1675-4ae8-854b-22d341b3700c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:38.494785 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be7ee4e4-1675-4ae8-854b-22d341b3700c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:38.494785 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be7ee4e4-1675-4ae8-854b-22d341b3700c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:38.495484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be7ee4e4-1675-4ae8-854b-22d341b3700c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:38.495996 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be7ee4e4-1675-4ae8-854b-22d341b3700c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:38.637238 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-be7ee4e4-1675-4ae8-854b-22d341b3700c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:38.646064 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-be7ee4e4-1675-4ae8-854b-22d341b3700c tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1722 microversion: 2.1 time: 0.163837 Jul 18 08:50:38.646652 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 267/545] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:38 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:38.690999 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-07327feb-4de8-4418-b271-cb67a2591219 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:38.691615 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-07327feb-4de8-4418-b271-cb67a2591219 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:38.698502 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-07327feb-4de8-4418-b271-cb67a2591219 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:38.698947 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-07327feb-4de8-4418-b271-cb67a2591219 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:38.699762 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-07327feb-4de8-4418-b271-cb67a2591219 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:38.700211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-07327feb-4de8-4418-b271-cb67a2591219 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:38.857752 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-07327feb-4de8-4418-b271-cb67a2591219 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:38.871943 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-07327feb-4de8-4418-b271-cb67a2591219 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.185237 Jul 18 08:50:38.876397 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 279/546] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:38 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:39.663684 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-609a4188-6175-4c5a-bce5-70c1471d71cd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:39.664310 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-609a4188-6175-4c5a-bce5-70c1471d71cd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:39.670740 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-609a4188-6175-4c5a-bce5-70c1471d71cd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:39.671196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-609a4188-6175-4c5a-bce5-70c1471d71cd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:39.672001 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-609a4188-6175-4c5a-bce5-70c1471d71cd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:39.672438 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-609a4188-6175-4c5a-bce5-70c1471d71cd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:39.818959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-609a4188-6175-4c5a-bce5-70c1471d71cd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:39.827615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-609a4188-6175-4c5a-bce5-70c1471d71cd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1722 microversion: 2.1 time: 0.167777 Jul 18 08:50:39.830696 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 268/547] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:39 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:39.898381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6ef39ac0-02ad-4558-8cb3-fd53e43a3515 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:39.898990 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6ef39ac0-02ad-4558-8cb3-fd53e43a3515 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:39.905600 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6ef39ac0-02ad-4558-8cb3-fd53e43a3515 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:39.906054 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6ef39ac0-02ad-4558-8cb3-fd53e43a3515 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:39.906883 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6ef39ac0-02ad-4558-8cb3-fd53e43a3515 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:39.907322 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6ef39ac0-02ad-4558-8cb3-fd53e43a3515 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:40.040957 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6ef39ac0-02ad-4558-8cb3-fd53e43a3515 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:40.049523 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6ef39ac0-02ad-4558-8cb3-fd53e43a3515 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1266 microversion: 2.1 time: 0.154893 Jul 18 08:50:40.050108 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 280/548] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:39 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:40.853678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3ed5cc1f-fa47-4f22-8ec2-5dfeb600b8b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:40.854327 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3ed5cc1f-fa47-4f22-8ec2-5dfeb600b8b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:40.856817 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=78 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:40.862784 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3ed5cc1f-fa47-4f22-8ec2-5dfeb600b8b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:40.866331 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3ed5cc1f-fa47-4f22-8ec2-5dfeb600b8b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:40.866331 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3ed5cc1f-fa47-4f22-8ec2-5dfeb600b8b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:40.866331 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3ed5cc1f-fa47-4f22-8ec2-5dfeb600b8b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.005999 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3ed5cc1f-fa47-4f22-8ec2-5dfeb600b8b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:41.014315 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3ed5cc1f-fa47-4f22-8ec2-5dfeb600b8b3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1728 microversion: 2.1 time: 0.164519 Jul 18 08:50:41.014902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 269/549] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:40 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:41.031030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7a46678a-f056-4cc9-9975-02fd7604abae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:41.031873 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7a46678a-f056-4cc9-9975-02fd7604abae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:41.038435 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a46678a-f056-4cc9-9975-02fd7604abae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.038890 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a46678a-f056-4cc9-9975-02fd7604abae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.039762 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a46678a-f056-4cc9-9975-02fd7604abae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.040210 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a46678a-f056-4cc9-9975-02fd7604abae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.067141 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a6c13613-b617-4a44-9907-113720a259ae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:41.067800 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a6c13613-b617-4a44-9907-113720a259ae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:41.074480 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a6c13613-b617-4a44-9907-113720a259ae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.074948 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a6c13613-b617-4a44-9907-113720a259ae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.075775 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a6c13613-b617-4a44-9907-113720a259ae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.076213 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a6c13613-b617-4a44-9907-113720a259ae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.128106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7a46678a-f056-4cc9-9975-02fd7604abae tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100878 Jul 18 08:50:41.128721 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 281/550] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 08:50:41 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:50:41.214027 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a6c13613-b617-4a44-9907-113720a259ae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:41.222683 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a6c13613-b617-4a44-9907-113720a259ae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1453 microversion: 2.1 time: 0.160128 Jul 18 08:50:41.223392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 270/551] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:41 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:41.239532 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0ed48971-e628-4643-b82c-f3fd7b35ffea tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:41.240180 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0ed48971-e628-4643-b82c-f3fd7b35ffea tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:41.246256 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ed48971-e628-4643-b82c-f3fd7b35ffea tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.246822 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ed48971-e628-4643-b82c-f3fd7b35ffea tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.247612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ed48971-e628-4643-b82c-f3fd7b35ffea tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.248092 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ed48971-e628-4643-b82c-f3fd7b35ffea tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.461929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-bc9a08ad-fa1b-46ef-ad4e-751647c2f841 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:41.462448 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-bc9a08ad-fa1b-46ef-ad4e-751647c2f841 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:41.470129 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bc9a08ad-fa1b-46ef-ad4e-751647c2f841 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.470578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bc9a08ad-fa1b-46ef-ad4e-751647c2f841 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.471354 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bc9a08ad-fa1b-46ef-ad4e-751647c2f841 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.471836 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bc9a08ad-fa1b-46ef-ad4e-751647c2f841 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.501401 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0ed48971-e628-4643-b82c-f3fd7b35ffea tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:41.505173 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-bc9a08ad-fa1b-46ef-ad4e-751647c2f841 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments/ecd8b240-c6bc-4461-b14f-8f55ca94cb83" status: 200 len: 194 microversion: 2.20 time: 0.046824 Jul 18 08:50:41.510437 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 271/552] 10.222.0.57 () {60 vars in 1453 bytes} [Mon Jul 18 08:50:41 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments/ecd8b240-c6bc-4461-b14f-8f55ca94cb83 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 08:50:41.510618 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0ed48971-e628-4643-b82c-f3fd7b35ffea tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1453 microversion: 2.1 time: 0.274054 Jul 18 08:50:41.510618 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 282/553] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:41 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1453 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:41.579062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3bc60840-a10a-4610-83d4-af65a3511d39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:41.579611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3bc60840-a10a-4610-83d4-af65a3511d39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:41.586424 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3bc60840-a10a-4610-83d4-af65a3511d39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.586992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3bc60840-a10a-4610-83d4-af65a3511d39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.587891 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3bc60840-a10a-4610-83d4-af65a3511d39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.588399 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3bc60840-a10a-4610-83d4-af65a3511d39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.683221 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-3bc60840-a10a-4610-83d4-af65a3511d39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lazy-loading 'services' on Instance uuid f3d6245b-0c6d-4a19-85c6-841d85912f2e {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:50:41.941740 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3bc60840-a10a-4610-83d4-af65a3511d39 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments/ecd8b240-c6bc-4461-b14f-8f55ca94cb83" status: 202 len: 0 microversion: 2.20 time: 0.367311 Jul 18 08:50:41.944878 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 272/554] 10.222.0.57 () {60 vars in 1456 bytes} [Mon Jul 18 08:50:41 2022] DELETE /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments/ecd8b240-c6bc-4461-b14f-8f55ca94cb83 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:50:41.951933 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a3baa02a-a1c5-4ac8-9cce-def12c235701 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:41.953625 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a3baa02a-a1c5-4ac8-9cce-def12c235701 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:41.959959 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3baa02a-a1c5-4ac8-9cce-def12c235701 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.960520 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3baa02a-a1c5-4ac8-9cce-def12c235701 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.961442 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3baa02a-a1c5-4ac8-9cce-def12c235701 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:41.962043 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3baa02a-a1c5-4ac8-9cce-def12c235701 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:41.995604 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a3baa02a-a1c5-4ac8-9cce-def12c235701 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048325 Jul 18 08:50:41.996128 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 283/555] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 08:50:41 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:50:42.503060 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-36213aef-2cd6-4a60-8f95-6355113c07f2 req-c669fa99-a3ac-4509-ac4a-57103a3aa981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d75586-3142-49ba-b48b-9db088664de7", "tag": "098eed33-e2bd-493f-826e-a819152c71b1"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:42.512736 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-36213aef-2cd6-4a60-8f95-6355113c07f2 req-c669fa99-a3ac-4509-ac4a-57103a3aa981 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:42.513290 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-36213aef-2cd6-4a60-8f95-6355113c07f2 req-c669fa99-a3ac-4509-ac4a-57103a3aa981 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:42.529086 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-36213aef-2cd6-4a60-8f95-6355113c07f2 req-c669fa99-a3ac-4509-ac4a-57103a3aa981 service nova] Creating event network-changed:098eed33-e2bd-493f-826e-a819152c71b1 for instance f3d75586-3142-49ba-b48b-9db088664de7 on hv-cinder-85014 Jul 18 08:50:42.537156 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-36213aef-2cd6-4a60-8f95-6355113c07f2 req-c669fa99-a3ac-4509-ac4a-57103a3aa981 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039092 Jul 18 08:50:42.537782 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 273/556] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:43.008234 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-13aa50a6-7b16-407d-aea0-060a26a68517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:43.009979 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-13aa50a6-7b16-407d-aea0-060a26a68517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:43.017020 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-13aa50a6-7b16-407d-aea0-060a26a68517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:43.017861 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-13aa50a6-7b16-407d-aea0-060a26a68517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:43.018923 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-13aa50a6-7b16-407d-aea0-060a26a68517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:43.019360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-13aa50a6-7b16-407d-aea0-060a26a68517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:43.076794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-13aa50a6-7b16-407d-aea0-060a26a68517 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072508 Jul 18 08:50:43.078392 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 284/557] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 08:50:43 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:50:44.092231 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b48fc644-73be-40d2-82cf-c5d69bdcc27c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:44.093381 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b48fc644-73be-40d2-82cf-c5d69bdcc27c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:44.101382 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b48fc644-73be-40d2-82cf-c5d69bdcc27c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:44.102045 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b48fc644-73be-40d2-82cf-c5d69bdcc27c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:44.102850 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b48fc644-73be-40d2-82cf-c5d69bdcc27c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:44.103299 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b48fc644-73be-40d2-82cf-c5d69bdcc27c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:44.140988 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b48fc644-73be-40d2-82cf-c5d69bdcc27c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053342 Jul 18 08:50:44.141634 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 274/558] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 08:50:44 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:44.224475 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-48ddebc3-e4b5-4b30-8f24-2bbd7a7458b4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:44.225304 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-48ddebc3-e4b5-4b30-8f24-2bbd7a7458b4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:44.227805 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:44.233215 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48ddebc3-e4b5-4b30-8f24-2bbd7a7458b4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:44.233672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48ddebc3-e4b5-4b30-8f24-2bbd7a7458b4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:44.235201 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48ddebc3-e4b5-4b30-8f24-2bbd7a7458b4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:44.235644 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48ddebc3-e4b5-4b30-8f24-2bbd7a7458b4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:44.264094 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-48ddebc3-e4b5-4b30-8f24-2bbd7a7458b4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:50:44.555843 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-785f218c-d4da-48dc-b548-f661d77e85ce req-ebc5d56b-7e63-42ac-a140-4dd545e1418a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d75586-3142-49ba-b48b-9db088664de7", "tag": "098eed33-e2bd-493f-826e-a819152c71b1"}, {"name": "network-changed", "server_uuid": "c53c5dca-7e2b-4a47-9a81-7888b20e67fe", "tag": "31760e24-104d-4678-9e4f-2ba58cdc21a9"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:44.565789 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-785f218c-d4da-48dc-b548-f661d77e85ce req-ebc5d56b-7e63-42ac-a140-4dd545e1418a service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:44.566347 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-785f218c-d4da-48dc-b548-f661d77e85ce req-ebc5d56b-7e63-42ac-a140-4dd545e1418a service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:44.580664 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-785f218c-d4da-48dc-b548-f661d77e85ce req-ebc5d56b-7e63-42ac-a140-4dd545e1418a service nova] Creating event network-changed:098eed33-e2bd-493f-826e-a819152c71b1 for instance f3d75586-3142-49ba-b48b-9db088664de7 on hv-cinder-85014 Jul 18 08:50:44.581274 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-785f218c-d4da-48dc-b548-f661d77e85ce req-ebc5d56b-7e63-42ac-a140-4dd545e1418a service nova] Creating event network-changed:31760e24-104d-4678-9e4f-2ba58cdc21a9 for instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe on hv-cinder-85014 Jul 18 08:50:44.588372 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-785f218c-d4da-48dc-b548-f661d77e85ce req-ebc5d56b-7e63-42ac-a140-4dd545e1418a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037413 Jul 18 08:50:44.589096 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 275/559] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:44.595431 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-48ddebc3-e4b5-4b30-8f24-2bbd7a7458b4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 204 len: 0 microversion: 2.20 time: 0.382801 Jul 18 08:50:44.596268 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 285/560] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 08:50:44 2022] DELETE /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 08:50:44.604621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-be1590e8-8b58-4b8b-8347-4898bed256f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:44.605445 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-be1590e8-8b58-4b8b-8347-4898bed256f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:44.612408 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be1590e8-8b58-4b8b-8347-4898bed256f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:44.615019 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be1590e8-8b58-4b8b-8347-4898bed256f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:44.615019 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be1590e8-8b58-4b8b-8347-4898bed256f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:44.615019 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be1590e8-8b58-4b8b-8347-4898bed256f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:44.764719 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-be1590e8-8b58-4b8b-8347-4898bed256f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:44.774515 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-be1590e8-8b58-4b8b-8347-4898bed256f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:44.776172 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-be1590e8-8b58-4b8b-8347-4898bed256f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:44.777563 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-be1590e8-8b58-4b8b-8347-4898bed256f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.177132 Jul 18 08:50:44.778222 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 276/561] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:50:44 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:50:45.797376 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7b13cad6-8b78-445a-a708-b7045e3f70a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:45.798065 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7b13cad6-8b78-445a-a708-b7045e3f70a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:45.804714 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b13cad6-8b78-445a-a708-b7045e3f70a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:45.805167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b13cad6-8b78-445a-a708-b7045e3f70a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:45.805930 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b13cad6-8b78-445a-a708-b7045e3f70a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:45.806369 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b13cad6-8b78-445a-a708-b7045e3f70a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:45.943624 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7b13cad6-8b78-445a-a708-b7045e3f70a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:45.952092 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7b13cad6-8b78-445a-a708-b7045e3f70a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:45.954394 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7b13cad6-8b78-445a-a708-b7045e3f70a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:45.955821 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7b13cad6-8b78-445a-a708-b7045e3f70a7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.162639 Jul 18 08:50:45.956173 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 286/562] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:50:45 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:50:46.980852 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9f5d31d8-2e98-4155-ae8d-1ff350c48937 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:46.982087 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9f5d31d8-2e98-4155-ae8d-1ff350c48937 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:46.989352 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9f5d31d8-2e98-4155-ae8d-1ff350c48937 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:46.989819 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9f5d31d8-2e98-4155-ae8d-1ff350c48937 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:46.990621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9f5d31d8-2e98-4155-ae8d-1ff350c48937 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:46.991137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9f5d31d8-2e98-4155-ae8d-1ff350c48937 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:47.474203 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9f5d31d8-2e98-4155-ae8d-1ff350c48937 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:47.480732 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-2dd6e71b-6173-4cce-84c7-a89151190cc0 req-f39a6125-33a4-447f-91c0-754535d7f9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d6245b-0c6d-4a19-85c6-841d85912f2e", "name": "network-vif-deleted", "tag": "222385f0-b84b-466b-a9f5-dab4e9dadd74"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:47.492865 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9f5d31d8-2e98-4155-ae8d-1ff350c48937 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:47.494356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9f5d31d8-2e98-4155-ae8d-1ff350c48937 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:47.499312 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9f5d31d8-2e98-4155-ae8d-1ff350c48937 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1723 microversion: 2.20 time: 0.524067 Jul 18 08:50:47.499312 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 277/563] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:50:46 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1723 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:50:47.515236 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-2dd6e71b-6173-4cce-84c7-a89151190cc0 req-f39a6125-33a4-447f-91c0-754535d7f9a8 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:47.516292 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-2dd6e71b-6173-4cce-84c7-a89151190cc0 req-f39a6125-33a4-447f-91c0-754535d7f9a8 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:47.537667 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-2dd6e71b-6173-4cce-84c7-a89151190cc0 req-f39a6125-33a4-447f-91c0-754535d7f9a8 service nova] Creating event network-vif-deleted:222385f0-b84b-466b-a9f5-dab4e9dadd74 for instance f3d6245b-0c6d-4a19-85c6-841d85912f2e on hv-cinder-85014 Jul 18 08:50:47.543584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-2dd6e71b-6173-4cce-84c7-a89151190cc0 req-f39a6125-33a4-447f-91c0-754535d7f9a8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069605 Jul 18 08:50:47.545898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 287/564] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:48.522807 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:48.523573 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:48.530566 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:48.531719 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:48.532573 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:48.533007 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:48.566029 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:48.566470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:48.566996 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lazy-loading 'fault' on Instance uuid f3d6245b-0c6d-4a19-85c6-841d85912f2e {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:50:48.621584 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:48.632778 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:48.634516 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:48.635882 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-334927c2-315e-4dfe-b7c9-ea327b57f25f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 200 len: 1372 microversion: 2.20 time: 0.116911 Jul 18 08:50:48.637261 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 278/565] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:50:48 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 1372 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:50:49.657063 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5a3a55be-d7a3-48d5-b6be-9519669ca831 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:49.658064 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5a3a55be-d7a3-48d5-b6be-9519669ca831 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:49.665263 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5a3a55be-d7a3-48d5-b6be-9519669ca831 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:49.666192 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5a3a55be-d7a3-48d5-b6be-9519669ca831 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:49.666483 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5a3a55be-d7a3-48d5-b6be-9519669ca831 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:49.667039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5a3a55be-d7a3-48d5-b6be-9519669ca831 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:49.685657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-5a3a55be-d7a3-48d5-b6be-9519669ca831 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] HTTP exception thrown: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5a3a55be-d7a3-48d5-b6be-9519669ca831 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Request method failure captured: Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e HTTP/1.1 Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3YZj6DKjyQMLZmR_B9Bah4Q0ybWgsBvnIj_l43C4dq_R6huNfGIoe0S4w4R_l5yEs8j_DSsu3EklYnCGyZNQW6PhSeNwV7XMAGsksCxPp0WZmwpi7yB0Zqv9ZiSK-vbu8J847YLZi6wTfjraURxb8BsUx34WH4PwoSPEJg63l2d2g Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:50:49.689953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ef2947427ce24f46baad0172db285cc8", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 88b4bd52ede644f0aac8dff94e09dd7d Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:50:49.691451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': 'f3d6245b-0c6d-4a19-85c6-841d85912f2e'} Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:50:49.692269 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:50:49.693612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:50:49.695007 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5a3a55be-d7a3-48d5-b6be-9519669ca831 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Returning 404 to user: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:50:49.695007 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5a3a55be-d7a3-48d5-b6be-9519669ca831 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 404 len: 111 microversion: 2.20 time: 0.037070 Jul 18 08:50:49.695007 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 288/566] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:50:49 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 08:50:49.698635 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-189d7c41-3375-48a5-b333-4be3757e0e08 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '.version_select at 0x7fafb72034c0>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:49.777517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-189d7c41-3375-48a5-b333-4be3757e0e08 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1424650667" status: 204 len: 0 microversion: 2.20 time: 0.082784 Jul 18 08:50:49.778104 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 279/567] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 08:50:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1424650667 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 08:50:50.474031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-caf9b6a6-bc01-4c93-bb7e-d35d03dfb965 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:50.475296 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-caf9b6a6-bc01-4c93-bb7e-d35d03dfb965 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:50.481057 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-caf9b6a6-bc01-4c93-bb7e-d35d03dfb965 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:50.481511 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-caf9b6a6-bc01-4c93-bb7e-d35d03dfb965 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:50.482282 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-caf9b6a6-bc01-4c93-bb7e-d35d03dfb965 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:50.482711 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-caf9b6a6-bc01-4c93-bb7e-d35d03dfb965 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:50.513811 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-caf9b6a6-bc01-4c93-bb7e-d35d03dfb965 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043675 Jul 18 08:50:50.514590 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 289/568] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:50:50 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 08:50:50.584808 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-eba5c5c6-ee76-492d-b8c9-6ca22b06b031 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:50.585303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-eba5c5c6-ee76-492d-b8c9-6ca22b06b031 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:50.592660 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eba5c5c6-ee76-492d-b8c9-6ca22b06b031 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:50.593120 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eba5c5c6-ee76-492d-b8c9-6ca22b06b031 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:50.594579 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eba5c5c6-ee76-492d-b8c9-6ca22b06b031 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:50.595022 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-eba5c5c6-ee76-492d-b8c9-6ca22b06b031 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:50.621662 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-eba5c5c6-ee76-492d-b8c9-6ca22b06b031 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Going to try to terminate instance {{(pid=124895) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:50:50.643266 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ba7edacb-ddc6-42e6-a4f7-ad56bfdb65bd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Action: 'create', calling method: .version_select at 0x7fafb7149ee0>, body: {"keypair": {"name": "tempest-keypair-1145646988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8nS0ldFe+AgHgPgidgJKoXTf8ncjEWmVVp/DLqJu5LBp7Dp9djreTc1mPiM+5j0ka8ds4k5i60dh+k5HxQgWt3c05LufsW/uOADjcZjY2xg/oFwCUF4VSClSCmkh/8/Q=="}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:50.658237 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-ba7edacb-ddc6-42e6-a4f7-ad56bfdb65bd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Getting quotas for project ef2947427ce24f46baad0172db285cc8. Resources: {'key_pairs'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:50:50.662905 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-ba7edacb-ddc6-42e6-a4f7-ad56bfdb65bd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Getting quotas for user 88b4bd52ede644f0aac8dff94e09dd7d and project ef2947427ce24f46baad0172db285cc8. Resources: {'key_pairs'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:50:50.760613 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ba7edacb-ddc6-42e6-a4f7-ad56bfdb65bd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.121592 Jul 18 08:50:50.761237 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 290/569] 10.222.0.57 () {62 vars in 1199 bytes} [Mon Jul 18 08:50:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 18 08:50:50.942368 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-eba5c5c6-ee76-492d-b8c9-6ca22b06b031 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 204 len: 0 microversion: 2.1 time: 0.361031 Jul 18 08:50:50.942858 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 280/570] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:50:50 2022] DELETE /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:50:50.951165 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ee576a71-ab55-4879-8292-474b97e22be8 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:50.951923 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ee576a71-ab55-4879-8292-474b97e22be8 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:50.959326 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ee576a71-ab55-4879-8292-474b97e22be8 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:50.959890 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ee576a71-ab55-4879-8292-474b97e22be8 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:50.960679 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ee576a71-ab55-4879-8292-474b97e22be8 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:50.961118 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ee576a71-ab55-4879-8292-474b97e22be8 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:51.110082 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ee576a71-ab55-4879-8292-474b97e22be8 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:51.118796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ee576a71-ab55-4879-8292-474b97e22be8 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1674 microversion: 2.1 time: 0.171274 Jul 18 08:50:51.122716 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 291/571] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:50 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:52.138129 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-be8c3ba7-a465-4c3d-b4aa-d1cb604832cd tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:52.138809 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-be8c3ba7-a465-4c3d-b4aa-d1cb604832cd tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:52.145772 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be8c3ba7-a465-4c3d-b4aa-d1cb604832cd tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:52.146227 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be8c3ba7-a465-4c3d-b4aa-d1cb604832cd tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:52.147004 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be8c3ba7-a465-4c3d-b4aa-d1cb604832cd tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:52.147443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be8c3ba7-a465-4c3d-b4aa-d1cb604832cd tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:52.361341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-be8c3ba7-a465-4c3d-b4aa-d1cb604832cd tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:52.363832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:52.370678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-be8c3ba7-a465-4c3d-b4aa-d1cb604832cd tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1674 microversion: 2.1 time: 0.236933 Jul 18 08:50:52.371272 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 281/572] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:52 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:53.314624 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1702087398", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0fa8b1e-26fd-4098-8362-a39708ae2c08"}], "security_groups": [{"name": "tempest-securitygroup--1021087861"}], "key_name": "tempest-keypair-1145646988", "user_data": "}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:53.388523 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-70777013-1e61-4255-a778-a0b02a2b4851 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:53.389394 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-70777013-1e61-4255-a778-a0b02a2b4851 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:53.397179 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-70777013-1e61-4255-a778-a0b02a2b4851 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:53.397642 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-70777013-1e61-4255-a778-a0b02a2b4851 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:53.398621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-70777013-1e61-4255-a778-a0b02a2b4851 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:53.399213 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-70777013-1e61-4255-a778-a0b02a2b4851 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:53.424075 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.network.neutron [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] validate_networks() for [('b0fa8b1e-26fd-4098-8362-a39708ae2c08', None, None, None, None, None)] {{(pid=124894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:50:53.682738 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-70777013-1e61-4255-a778-a0b02a2b4851 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:53.690828 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-70777013-1e61-4255-a778-a0b02a2b4851 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1674 microversion: 2.1 time: 0.307367 Jul 18 08:50:53.691415 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 282/573] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:53 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1674 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:53.812636 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Flavor limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:50:53.818915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Image limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:50:53.818915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Flavor pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:50:53.818915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Image pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:50:53.818915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:50:53.823848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:53.824313 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:53.825122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:53.825569 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:53.845160 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Getting quotas for project ef2947427ce24f46baad0172db285cc8. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:50:53.849506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Getting quotas for user 88b4bd52ede644f0aac8dff94e09dd7d and project ef2947427ce24f46baad0172db285cc8. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:50:53.861596 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Going to run 1 instances... {{(pid=124894) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:50:53.863930 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:50:54.053590 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-984201ab-35c2-4ea0-a493-009bd0ac902f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.743907 Jul 18 08:50:54.060276 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 292/574] 10.222.0.57 () {62 vars in 1187 bytes} [Mon Jul 18 08:50:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 08:50:54.066379 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d6355dde-666a-4656-bd90-3aac46309713 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:54.067026 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d6355dde-666a-4656-bd90-3aac46309713 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:54.138102 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d6355dde-666a-4656-bd90-3aac46309713 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:54.147993 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d6355dde-666a-4656-bd90-3aac46309713 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:54.149879 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d6355dde-666a-4656-bd90-3aac46309713 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:54.151061 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d6355dde-666a-4656-bd90-3aac46309713 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1282 microversion: 2.20 time: 0.089076 Jul 18 08:50:54.151994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 283/575] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:50:54 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:50:54.302802 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7e96cf81-87fa-451d-84c2-9f28f9d145c1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:54.304170 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7e96cf81-87fa-451d-84c2-9f28f9d145c1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:54.312815 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7e96cf81-87fa-451d-84c2-9f28f9d145c1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:54.312815 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7e96cf81-87fa-451d-84c2-9f28f9d145c1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:54.312815 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7e96cf81-87fa-451d-84c2-9f28f9d145c1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:54.312815 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7e96cf81-87fa-451d-84c2-9f28f9d145c1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:54.316561 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:50:54.361656 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-22ec8381-3f0d-49ef-81df-57e07e978623 req-253ecc99-4fe5-431a-b251-b05f0276f4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcda6e64-2c95-4eb7-bff6-6e13f99e254e", "name": "network-vif-deleted", "tag": "01362a2e-5dd9-4114-9738-0a7259b6d8be"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:54.391926 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-22ec8381-3f0d-49ef-81df-57e07e978623 req-253ecc99-4fe5-431a-b251-b05f0276f4e2 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:54.391926 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-22ec8381-3f0d-49ef-81df-57e07e978623 req-253ecc99-4fe5-431a-b251-b05f0276f4e2 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:54.402218 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-22ec8381-3f0d-49ef-81df-57e07e978623 req-253ecc99-4fe5-431a-b251-b05f0276f4e2 service nova] Creating event network-vif-deleted:01362a2e-5dd9-4114-9738-0a7259b6d8be for instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e on hv-cinder-85014 Jul 18 08:50:54.407550 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-22ec8381-3f0d-49ef-81df-57e07e978623 req-253ecc99-4fe5-431a-b251-b05f0276f4e2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050130 Jul 18 08:50:54.408477 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 284/576] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:54.588423 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7e96cf81-87fa-451d-84c2-9f28f9d145c1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "POST /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/action" status: 202 len: 0 microversion: 2.1 time: 0.289505 Jul 18 08:50:54.589315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 293/577] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:50:54 2022] POST /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:50:54.601163 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-aca37e6f-c9ce-44d0-8ded-bb5c2e63bef7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:54.601843 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-aca37e6f-c9ce-44d0-8ded-bb5c2e63bef7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:54.612115 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aca37e6f-c9ce-44d0-8ded-bb5c2e63bef7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:54.612780 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aca37e6f-c9ce-44d0-8ded-bb5c2e63bef7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:54.616286 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aca37e6f-c9ce-44d0-8ded-bb5c2e63bef7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:54.616286 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aca37e6f-c9ce-44d0-8ded-bb5c2e63bef7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:54.722622 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-37497c48-3067-4e0c-bbff-916d1ca5d60f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:54.724602 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-37497c48-3067-4e0c-bbff-916d1ca5d60f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:54.744589 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-37497c48-3067-4e0c-bbff-916d1ca5d60f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:54.745822 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-37497c48-3067-4e0c-bbff-916d1ca5d60f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:54.747976 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-37497c48-3067-4e0c-bbff-916d1ca5d60f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:54.748800 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-37497c48-3067-4e0c-bbff-916d1ca5d60f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:54.856821 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-aca37e6f-c9ce-44d0-8ded-bb5c2e63bef7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:54.869953 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-aca37e6f-c9ce-44d0-8ded-bb5c2e63bef7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1751 microversion: 2.1 time: 0.273385 Jul 18 08:50:54.871351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 285/578] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:54 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1751 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:54.883364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-37497c48-3067-4e0c-bbff-916d1ca5d60f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:54.892843 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-37497c48-3067-4e0c-bbff-916d1ca5d60f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 200 len: 1322 microversion: 2.1 time: 0.186443 Jul 18 08:50:54.903065 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 294/579] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:54 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:55.170536 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-76a8c270-f147-45b2-a59b-bbfdfb87c8ca tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:55.171404 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-76a8c270-f147-45b2-a59b-bbfdfb87c8ca tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:55.179151 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-76a8c270-f147-45b2-a59b-bbfdfb87c8ca tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:55.179606 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-76a8c270-f147-45b2-a59b-bbfdfb87c8ca tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:55.183256 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-76a8c270-f147-45b2-a59b-bbfdfb87c8ca tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:55.183256 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-76a8c270-f147-45b2-a59b-bbfdfb87c8ca tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:55.257922 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-76a8c270-f147-45b2-a59b-bbfdfb87c8ca tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:55.266824 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-76a8c270-f147-45b2-a59b-bbfdfb87c8ca tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:55.268543 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-76a8c270-f147-45b2-a59b-bbfdfb87c8ca tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:55.269527 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-76a8c270-f147-45b2-a59b-bbfdfb87c8ca tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1286 microversion: 2.20 time: 0.102925 Jul 18 08:50:55.270099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 286/580] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:50:55 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:50:55.894035 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-191bca3c-ee74-4bd0-9c3a-e378615e3bf1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:55.895268 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-191bca3c-ee74-4bd0-9c3a-e378615e3bf1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:55.902460 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-191bca3c-ee74-4bd0-9c3a-e378615e3bf1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:55.902912 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-191bca3c-ee74-4bd0-9c3a-e378615e3bf1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:55.903713 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-191bca3c-ee74-4bd0-9c3a-e378615e3bf1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:55.904154 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-191bca3c-ee74-4bd0-9c3a-e378615e3bf1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:55.911624 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c4f8c831-120f-45f2-b5df-f420647bace0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:55.913989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c4f8c831-120f-45f2-b5df-f420647bace0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:55.920098 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c4f8c831-120f-45f2-b5df-f420647bace0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:55.920823 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c4f8c831-120f-45f2-b5df-f420647bace0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:55.922925 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c4f8c831-120f-45f2-b5df-f420647bace0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:55.923596 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c4f8c831-120f-45f2-b5df-f420647bace0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:55.939281 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-c4f8c831-120f-45f2-b5df-f420647bace0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] HTTP exception thrown: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c4f8c831-120f-45f2-b5df-f420647bace0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Request method failure captured: Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e HTTP/1.1 Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3coSe05_vBCD8cZm6om8IgfnRk5zeZpdXZJGCQeHl482XmuHJbG5WZ-c8gvulc29ZQPXglG_5yOwm1YAeT7_UH0M_nOaLD0vaZHGGW3U_oayZrIdVKXmIaHe82CpJ0VV1R0ljRZo83d71n6qdyQJtzcX-8ir2dVmZiP1BA7VYOun0 Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:50:55.940979 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d7367af701b84358a4e5c5d0db473b44", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 94eed85a730b46dcb1cf694a3ebf2d3a Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:50:55.944084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'fcda6e64-2c95-4eb7-bff6-6e13f99e254e'} Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:50:55.944989 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:50:55.946504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:50:55.947815 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c4f8c831-120f-45f2-b5df-f420647bace0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Returning 404 to user: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:50:55.947815 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c4f8c831-120f-45f2-b5df-f420647bace0 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 404 len: 111 microversion: 2.1 time: 0.035304 Jul 18 08:50:55.947815 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 287/581] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:55 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:50:55.951237 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a01fe893-a33a-45d4-926d-ca8b23d9fe95 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '.version_select at 0x7fafb727f5e0>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:56.056608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-191bca3c-ee74-4bd0-9c3a-e378615e3bf1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:56.066047 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-191bca3c-ee74-4bd0-9c3a-e378615e3bf1 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.177659 Jul 18 08:50:56.066614 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 295/582] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:55 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:50:56.079257 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a01fe893-a33a-45d4-926d-ca8b23d9fe95 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1895949044" status: 202 len: 0 microversion: 2.1 time: 0.131141 Jul 18 08:50:56.080347 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 288/583] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 08:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1895949044 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:50:56.287445 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1779db5d-e10c-4bfc-aa89-2def9f6a652f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:56.288102 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1779db5d-e10c-4bfc-aa89-2def9f6a652f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:56.294099 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1779db5d-e10c-4bfc-aa89-2def9f6a652f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:56.294744 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1779db5d-e10c-4bfc-aa89-2def9f6a652f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:56.295499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1779db5d-e10c-4bfc-aa89-2def9f6a652f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:56.295961 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1779db5d-e10c-4bfc-aa89-2def9f6a652f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:56.363159 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1779db5d-e10c-4bfc-aa89-2def9f6a652f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:56.373078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1779db5d-e10c-4bfc-aa89-2def9f6a652f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:56.373753 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1779db5d-e10c-4bfc-aa89-2def9f6a652f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:56.376051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1779db5d-e10c-4bfc-aa89-2def9f6a652f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1334 microversion: 2.20 time: 0.092463 Jul 18 08:50:56.376969 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 296/584] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:50:56 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:50:56.946099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2e5b224f-cc25-47a7-b9ba-ef3205be15ba tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Action: 'create', calling method: .version_select at 0x7fafb71ed1f0>, body: {"keypair": {"name": "tempest-keypair-873754792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqSSuroCUpGcvkJeUh/l+F4abkqlIGF8q45uqM7rx//mooyvyNzndBO6kflZdZrCj6d0/In34DTNVoE3Ruo8NmXZo9RfcIyMmqEPHSY9oqrfYA3cdqPwarp5/ohVEKLVg=="}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:56.966328 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-2e5b224f-cc25-47a7-b9ba-ef3205be15ba tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Getting quotas for project d7367af701b84358a4e5c5d0db473b44. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:50:56.971461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-2e5b224f-cc25-47a7-b9ba-ef3205be15ba tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Getting quotas for user 94eed85a730b46dcb1cf694a3ebf2d3a and project d7367af701b84358a4e5c5d0db473b44. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:50:57.085005 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-551fbd73-b589-42d7-baa6-81eb974c46d8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:57.085881 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-551fbd73-b589-42d7-baa6-81eb974c46d8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:57.095507 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-551fbd73-b589-42d7-baa6-81eb974c46d8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:57.095640 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-551fbd73-b589-42d7-baa6-81eb974c46d8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:57.096504 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-551fbd73-b589-42d7-baa6-81eb974c46d8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:57.096895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-551fbd73-b589-42d7-baa6-81eb974c46d8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:57.127338 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2e5b224f-cc25-47a7-b9ba-ef3205be15ba tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.185639 Jul 18 08:50:57.128093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 289/585] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 08:50:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:57.263445 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-551fbd73-b589-42d7-baa6-81eb974c46d8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:57.272164 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-551fbd73-b589-42d7-baa6-81eb974c46d8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.191396 Jul 18 08:50:57.272834 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 297/586] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:57 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:57.395207 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c39e7822-a7d9-4964-b98b-9f1d12fa7cfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:57.395858 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c39e7822-a7d9-4964-b98b-9f1d12fa7cfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:57.402121 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c39e7822-a7d9-4964-b98b-9f1d12fa7cfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:57.402577 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c39e7822-a7d9-4964-b98b-9f1d12fa7cfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:57.403356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c39e7822-a7d9-4964-b98b-9f1d12fa7cfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:57.403839 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c39e7822-a7d9-4964-b98b-9f1d12fa7cfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:57.472809 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c39e7822-a7d9-4964-b98b-9f1d12fa7cfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:57.481162 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c39e7822-a7d9-4964-b98b-9f1d12fa7cfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:57.482674 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c39e7822-a7d9-4964-b98b-9f1d12fa7cfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:57.483842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c39e7822-a7d9-4964-b98b-9f1d12fa7cfa tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1340 microversion: 2.20 time: 0.093336 Jul 18 08:50:57.484717 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 290/587] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:50:57 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:50:58.295164 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b8aebcc1-6f70-4af9-9931-12b7d178d978 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:58.295882 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b8aebcc1-6f70-4af9-9931-12b7d178d978 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:58.302830 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b8aebcc1-6f70-4af9-9931-12b7d178d978 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:58.303281 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b8aebcc1-6f70-4af9-9931-12b7d178d978 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:58.304111 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b8aebcc1-6f70-4af9-9931-12b7d178d978 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:58.308989 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b8aebcc1-6f70-4af9-9931-12b7d178d978 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:58.483230 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b8aebcc1-6f70-4af9-9931-12b7d178d978 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:58.488341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b8aebcc1-6f70-4af9-9931-12b7d178d978 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.197095 Jul 18 08:50:58.489385 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 298/588] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:58 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:58.508576 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ece9f39e-3116-4c91-adb9-eefd807f6ede tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:58.510754 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ece9f39e-3116-4c91-adb9-eefd807f6ede tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:58.518579 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ece9f39e-3116-4c91-adb9-eefd807f6ede tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:58.519308 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ece9f39e-3116-4c91-adb9-eefd807f6ede tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:58.520115 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ece9f39e-3116-4c91-adb9-eefd807f6ede tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:58.520546 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ece9f39e-3116-4c91-adb9-eefd807f6ede tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:58.727040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ece9f39e-3116-4c91-adb9-eefd807f6ede tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:58.737331 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ece9f39e-3116-4c91-adb9-eefd807f6ede tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:58.741011 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ece9f39e-3116-4c91-adb9-eefd807f6ede tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:58.741648 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ece9f39e-3116-4c91-adb9-eefd807f6ede tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1408 microversion: 2.20 time: 0.237535 Jul 18 08:50:58.742656 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 291/589] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:50:58 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:50:58.850576 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-0b4b5eeb-2867-4678-91b5-204a46a55bd0 req-fe04bc90-d858-4516-b560-87d1b347c4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18040578-a916-4929-ae00-067b0441f8e7", "tag": "87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:50:58.862664 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-0b4b5eeb-2867-4678-91b5-204a46a55bd0 req-fe04bc90-d858-4516-b560-87d1b347c4a9 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:58.863543 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-0b4b5eeb-2867-4678-91b5-204a46a55bd0 req-fe04bc90-d858-4516-b560-87d1b347c4a9 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:58.877745 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-0b4b5eeb-2867-4678-91b5-204a46a55bd0 req-fe04bc90-d858-4516-b560-87d1b347c4a9 service nova] Creating event network-changed:87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd for instance 18040578-a916-4929-ae00-067b0441f8e7 on hv-cinder-85014 Jul 18 08:50:58.893920 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-0b4b5eeb-2867-4678-91b5-204a46a55bd0 req-fe04bc90-d858-4516-b560-87d1b347c4a9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050064 Jul 18 08:50:58.895576 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 299/590] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:50:59.506724 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c749a421-4044-452e-b389-9d03f204e515 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:59.507903 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c749a421-4044-452e-b389-9d03f204e515 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:59.514744 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c749a421-4044-452e-b389-9d03f204e515 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:59.516970 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c749a421-4044-452e-b389-9d03f204e515 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:59.516970 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c749a421-4044-452e-b389-9d03f204e515 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:59.516970 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c749a421-4044-452e-b389-9d03f204e515 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:59.769053 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-522844e2-c98a-4f59-8526-55607f5520e6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:50:59.769685 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-522844e2-c98a-4f59-8526-55607f5520e6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:50:59.774218 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c749a421-4044-452e-b389-9d03f204e515 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:59.777061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-522844e2-c98a-4f59-8526-55607f5520e6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:59.777518 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-522844e2-c98a-4f59-8526-55607f5520e6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:59.778292 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-522844e2-c98a-4f59-8526-55607f5520e6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:50:59.778721 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-522844e2-c98a-4f59-8526-55607f5520e6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:50:59.783707 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c749a421-4044-452e-b389-9d03f204e515 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.280846 Jul 18 08:50:59.793351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 292/591] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:50:59 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:50:59.940450 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-522844e2-c98a-4f59-8526-55607f5520e6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:59.952179 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-522844e2-c98a-4f59-8526-55607f5520e6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:59.954622 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-522844e2-c98a-4f59-8526-55607f5520e6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:50:59.956601 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-522844e2-c98a-4f59-8526-55607f5520e6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1408 microversion: 2.20 time: 0.192230 Jul 18 08:50:59.957221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 300/592] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:50:59 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:50:59.992078 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1824867812", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d509bc50-58ee-41ee-9bed-bf209325abb8"}], "security_groups": [{"name": "tempest-securitygroup--1268245971"}], "key_name": "tempest-keypair-873754792", "user_data": "}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:00.102734 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] validate_networks() for [('d509bc50-58ee-41ee-9bed-bf209325abb8', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:51:00.471660 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:51:00.472114 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:51:00.472618 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:51:00.473032 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:51:00.473451 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:51:00.482376 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:00.482827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:00.483641 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:00.484108 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:00.501262 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Getting quotas for project d7367af701b84358a4e5c5d0db473b44. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:51:00.505342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Getting quotas for user 94eed85a730b46dcb1cf694a3ebf2d3a and project d7367af701b84358a4e5c5d0db473b44. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:51:00.517617 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:51:00.519950 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:51:00.643161 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f47024a7-152a-4e5c-974f-75248279a6ce tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.654942 Jul 18 08:51:00.643824 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 293/593] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:50:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:51:00.654515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-95a6fa2a-505c-49a6-b688-05ca13e31b3a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:00.655324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-95a6fa2a-505c-49a6-b688-05ca13e31b3a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:00.716880 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-95a6fa2a-505c-49a6-b688-05ca13e31b3a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:00.724550 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-95a6fa2a-505c-49a6-b688-05ca13e31b3a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1237 microversion: 2.1 time: 0.074310 Jul 18 08:51:00.725142 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 301/594] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:00 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:00.800805 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-bf17d8c7-0d47-4523-ab40-5367492e5d6e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:00.801474 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-bf17d8c7-0d47-4523-ab40-5367492e5d6e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:00.808458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bf17d8c7-0d47-4523-ab40-5367492e5d6e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:00.808908 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bf17d8c7-0d47-4523-ab40-5367492e5d6e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:00.809677 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bf17d8c7-0d47-4523-ab40-5367492e5d6e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:00.810115 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bf17d8c7-0d47-4523-ab40-5367492e5d6e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:00.961582 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-bf17d8c7-0d47-4523-ab40-5367492e5d6e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:00.971005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-bf17d8c7-0d47-4523-ab40-5367492e5d6e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.173946 Jul 18 08:51:00.971492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 294/595] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:00 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:00.974692 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-012f94cc-c19a-4414-a145-28e17bcad5ce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:00.975307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-012f94cc-c19a-4414-a145-28e17bcad5ce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:00.981884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-012f94cc-c19a-4414-a145-28e17bcad5ce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:00.982342 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-012f94cc-c19a-4414-a145-28e17bcad5ce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:00.983107 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-012f94cc-c19a-4414-a145-28e17bcad5ce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:00.983542 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-012f94cc-c19a-4414-a145-28e17bcad5ce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:01.118762 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-012f94cc-c19a-4414-a145-28e17bcad5ce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:01.130027 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-012f94cc-c19a-4414-a145-28e17bcad5ce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:01.131597 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-012f94cc-c19a-4414-a145-28e17bcad5ce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:01.132748 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-012f94cc-c19a-4414-a145-28e17bcad5ce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1408 microversion: 2.20 time: 0.162019 Jul 18 08:51:01.133356 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 302/596] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:51:00 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:51:01.742491 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b477d837-9bcd-42a9-949d-18dd6adce235 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:01.743053 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b477d837-9bcd-42a9-949d-18dd6adce235 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:01.749703 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b477d837-9bcd-42a9-949d-18dd6adce235 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:01.750359 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b477d837-9bcd-42a9-949d-18dd6adce235 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:01.751293 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b477d837-9bcd-42a9-949d-18dd6adce235 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:01.751776 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b477d837-9bcd-42a9-949d-18dd6adce235 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:01.820604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b477d837-9bcd-42a9-949d-18dd6adce235 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:01.829361 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b477d837-9bcd-42a9-949d-18dd6adce235 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1241 microversion: 2.1 time: 0.090802 Jul 18 08:51:01.829863 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 295/597] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:01 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:51:01.988737 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ec9778c4-fb5b-4e41-9e76-6af7d3ca8879 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:01.989279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ec9778c4-fb5b-4e41-9e76-6af7d3ca8879 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:01.995959 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec9778c4-fb5b-4e41-9e76-6af7d3ca8879 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:01.996346 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec9778c4-fb5b-4e41-9e76-6af7d3ca8879 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:01.997127 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec9778c4-fb5b-4e41-9e76-6af7d3ca8879 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:01.997564 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec9778c4-fb5b-4e41-9e76-6af7d3ca8879 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:02.144507 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ec9778c4-fb5b-4e41-9e76-6af7d3ca8879 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:02.150249 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-49b1e060-201c-4533-9009-181e10579670 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:02.152549 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-49b1e060-201c-4533-9009-181e10579670 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:02.152813 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ec9778c4-fb5b-4e41-9e76-6af7d3ca8879 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.168020 Jul 18 08:51:02.153406 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 303/598] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:01 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:02.157667 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-49b1e060-201c-4533-9009-181e10579670 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:02.158111 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-49b1e060-201c-4533-9009-181e10579670 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:02.158879 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-49b1e060-201c-4533-9009-181e10579670 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:02.159314 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-49b1e060-201c-4533-9009-181e10579670 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:02.293890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-49b1e060-201c-4533-9009-181e10579670 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:02.302604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-49b1e060-201c-4533-9009-181e10579670 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:02.304144 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-49b1e060-201c-4533-9009-181e10579670 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:02.305295 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-49b1e060-201c-4533-9009-181e10579670 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1408 microversion: 2.20 time: 0.158853 Jul 18 08:51:02.305857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 296/599] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:51:02 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:51:02.846762 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-55d8c27e-fc70-4aa8-8d50-3779a3366d90 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:02.847723 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-55d8c27e-fc70-4aa8-8d50-3779a3366d90 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:02.855067 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-55d8c27e-fc70-4aa8-8d50-3779a3366d90 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:02.855605 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-55d8c27e-fc70-4aa8-8d50-3779a3366d90 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:02.856493 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-55d8c27e-fc70-4aa8-8d50-3779a3366d90 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:02.857008 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-55d8c27e-fc70-4aa8-8d50-3779a3366d90 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:02.926515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-55d8c27e-fc70-4aa8-8d50-3779a3366d90 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:02.934886 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-55d8c27e-fc70-4aa8-8d50-3779a3366d90 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1307 microversion: 2.1 time: 0.092525 Jul 18 08:51:02.935480 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 304/600] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:02 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:03.170784 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-07656d90-2abe-43ce-af18-754fb15829ec tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:03.172776 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-07656d90-2abe-43ce-af18-754fb15829ec tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:03.179486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-07656d90-2abe-43ce-af18-754fb15829ec tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:03.179972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-07656d90-2abe-43ce-af18-754fb15829ec tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:03.180782 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-07656d90-2abe-43ce-af18-754fb15829ec tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:03.181234 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-07656d90-2abe-43ce-af18-754fb15829ec tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:03.324139 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e46329a4-0cdf-421b-86bf-b386abd24085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:03.324797 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e46329a4-0cdf-421b-86bf-b386abd24085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:03.332101 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e46329a4-0cdf-421b-86bf-b386abd24085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:03.332562 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e46329a4-0cdf-421b-86bf-b386abd24085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:03.333385 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e46329a4-0cdf-421b-86bf-b386abd24085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:03.333830 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e46329a4-0cdf-421b-86bf-b386abd24085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:03.350595 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-07656d90-2abe-43ce-af18-754fb15829ec tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:03.359190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-07656d90-2abe-43ce-af18-754fb15829ec tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.192321 Jul 18 08:51:03.360516 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 297/601] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:03 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:03.510552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e46329a4-0cdf-421b-86bf-b386abd24085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:03.520657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e46329a4-0cdf-421b-86bf-b386abd24085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:03.522215 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e46329a4-0cdf-421b-86bf-b386abd24085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:03.523598 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e46329a4-0cdf-421b-86bf-b386abd24085 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1408 microversion: 2.20 time: 0.203471 Jul 18 08:51:03.532355 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 305/602] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:51:03 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:51:03.960520 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-01be5aa7-b804-476e-a662-2392270e571c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:03.961129 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-01be5aa7-b804-476e-a662-2392270e571c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:03.967188 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-01be5aa7-b804-476e-a662-2392270e571c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:03.967634 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-01be5aa7-b804-476e-a662-2392270e571c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:03.968714 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-01be5aa7-b804-476e-a662-2392270e571c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:03.969042 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-01be5aa7-b804-476e-a662-2392270e571c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:04.204732 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-01be5aa7-b804-476e-a662-2392270e571c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:04.213351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-01be5aa7-b804-476e-a662-2392270e571c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1363 microversion: 2.1 time: 0.256580 Jul 18 08:51:04.214133 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 298/603] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:03 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:04.380620 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-af45950e-519c-48eb-8892-ac31504cc4db tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:04.386129 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-af45950e-519c-48eb-8892-ac31504cc4db tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:04.386129 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:04.389124 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af45950e-519c-48eb-8892-ac31504cc4db tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:04.389586 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af45950e-519c-48eb-8892-ac31504cc4db tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:04.391455 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af45950e-519c-48eb-8892-ac31504cc4db tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:04.392138 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af45950e-519c-48eb-8892-ac31504cc4db tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:04.465568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-63d65e4e-7be1-4578-9f4d-d77e20f7e39f req-1e470a2c-1e94-4a65-a3e0-7ed23aece1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7d6682-c259-49a3-b61d-46ac98ff9948", "tag": "5a31bcdc-6257-4e32-bc32-f336670e10fd"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:04.481076 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:04.494842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-63d65e4e-7be1-4578-9f4d-d77e20f7e39f req-1e470a2c-1e94-4a65-a3e0-7ed23aece1b3 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:04.495300 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-63d65e4e-7be1-4578-9f4d-d77e20f7e39f req-1e470a2c-1e94-4a65-a3e0-7ed23aece1b3 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:04.522011 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-63d65e4e-7be1-4578-9f4d-d77e20f7e39f req-1e470a2c-1e94-4a65-a3e0-7ed23aece1b3 service nova] Creating event network-changed:5a31bcdc-6257-4e32-bc32-f336670e10fd for instance fb7d6682-c259-49a3-b61d-46ac98ff9948 on hv-cinder-85014 Jul 18 08:51:04.529541 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-63d65e4e-7be1-4578-9f4d-d77e20f7e39f req-1e470a2c-1e94-4a65-a3e0-7ed23aece1b3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069189 Jul 18 08:51:04.534978 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 299/604] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:51:04.542118 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-73deea27-8f2d-4331-8732-07e5a65c3c30 req-f3102978-906a-42cc-84ba-9ca0eadcdbad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18040578-a916-4929-ae00-067b0441f8e7", "name": "network-vif-plugged", "status": "completed", "tag": "87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:04.553683 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-73deea27-8f2d-4331-8732-07e5a65c3c30 req-f3102978-906a-42cc-84ba-9ca0eadcdbad service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:04.555358 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-73deea27-8f2d-4331-8732-07e5a65c3c30 req-f3102978-906a-42cc-84ba-9ca0eadcdbad service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:04.582370 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-73deea27-8f2d-4331-8732-07e5a65c3c30 req-f3102978-906a-42cc-84ba-9ca0eadcdbad service nova] Creating event network-vif-plugged:87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd for instance 18040578-a916-4929-ae00-067b0441f8e7 on hv-cinder-85014 Jul 18 08:51:04.599751 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-73deea27-8f2d-4331-8732-07e5a65c3c30 req-f3102978-906a-42cc-84ba-9ca0eadcdbad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062927 Jul 18 08:51:04.600705 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 300/605] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:04.612340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9b3c70bc-e807-49c4-8818-b998ba5e9b94 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:04.615801 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9b3c70bc-e807-49c4-8818-b998ba5e9b94 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:04.630102 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-af45950e-519c-48eb-8892-ac31504cc4db tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:04.630319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9b3c70bc-e807-49c4-8818-b998ba5e9b94 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:04.630319 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9b3c70bc-e807-49c4-8818-b998ba5e9b94 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:04.632444 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9b3c70bc-e807-49c4-8818-b998ba5e9b94 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:04.634483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9b3c70bc-e807-49c4-8818-b998ba5e9b94 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:04.640956 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-af45950e-519c-48eb-8892-ac31504cc4db tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.264196 Jul 18 08:51:04.642261 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 306/606] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:04 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:04.790503 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9b3c70bc-e807-49c4-8818-b998ba5e9b94 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:04.798885 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9b3c70bc-e807-49c4-8818-b998ba5e9b94 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:04.800424 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9b3c70bc-e807-49c4-8818-b998ba5e9b94 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:04.801683 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9b3c70bc-e807-49c4-8818-b998ba5e9b94 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1408 microversion: 2.20 time: 0.199419 Jul 18 08:51:04.802097 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 301/607] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:51:04 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:51:05.231654 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0b177c83-5f1e-481d-b0cf-c13d04980aa6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:05.232279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0b177c83-5f1e-481d-b0cf-c13d04980aa6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:05.239242 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0b177c83-5f1e-481d-b0cf-c13d04980aa6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:05.239708 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0b177c83-5f1e-481d-b0cf-c13d04980aa6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:05.240471 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0b177c83-5f1e-481d-b0cf-c13d04980aa6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:05.240909 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0b177c83-5f1e-481d-b0cf-c13d04980aa6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:05.374169 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0b177c83-5f1e-481d-b0cf-c13d04980aa6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:05.382591 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0b177c83-5f1e-481d-b0cf-c13d04980aa6 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1363 microversion: 2.1 time: 0.154774 Jul 18 08:51:05.383204 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 307/608] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:05 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:05.658933 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f4405e2a-ee67-4720-a70a-30c96e8589a3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:05.659584 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f4405e2a-ee67-4720-a70a-30c96e8589a3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:05.666615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f4405e2a-ee67-4720-a70a-30c96e8589a3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:05.667070 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f4405e2a-ee67-4720-a70a-30c96e8589a3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:05.667873 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f4405e2a-ee67-4720-a70a-30c96e8589a3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:05.668298 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f4405e2a-ee67-4720-a70a-30c96e8589a3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:05.819830 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-83f08ca4-c50d-4138-908e-671c8ffc8583 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:05.825366 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-83f08ca4-c50d-4138-908e-671c8ffc8583 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:05.826926 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-83f08ca4-c50d-4138-908e-671c8ffc8583 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:05.827391 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-83f08ca4-c50d-4138-908e-671c8ffc8583 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:05.829071 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-83f08ca4-c50d-4138-908e-671c8ffc8583 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:05.829591 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-83f08ca4-c50d-4138-908e-671c8ffc8583 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:05.891295 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f4405e2a-ee67-4720-a70a-30c96e8589a3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:05.900004 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f4405e2a-ee67-4720-a70a-30c96e8589a3 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.245165 Jul 18 08:51:05.900679 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 302/609] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:05 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:05.986035 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-83f08ca4-c50d-4138-908e-671c8ffc8583 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:05.996517 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-83f08ca4-c50d-4138-908e-671c8ffc8583 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:05.998020 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-83f08ca4-c50d-4138-908e-671c8ffc8583 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:05.999147 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-83f08ca4-c50d-4138-908e-671c8ffc8583 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1408 microversion: 2.20 time: 0.183483 Jul 18 08:51:06.000321 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 308/610] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:51:05 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:51:06.400691 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-16132435-8d21-4341-945f-8f099799b87e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:06.401273 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-16132435-8d21-4341-945f-8f099799b87e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:06.408362 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-16132435-8d21-4341-945f-8f099799b87e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:06.408809 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-16132435-8d21-4341-945f-8f099799b87e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:06.409579 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-16132435-8d21-4341-945f-8f099799b87e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:06.410012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-16132435-8d21-4341-945f-8f099799b87e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:06.560716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-16132435-8d21-4341-945f-8f099799b87e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:06.569575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-16132435-8d21-4341-945f-8f099799b87e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1363 microversion: 2.1 time: 0.173119 Jul 18 08:51:06.570262 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 303/611] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:06 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:06.917699 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bbbe091b-b339-4474-80e5-dac6bca47fd2 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:06.918312 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bbbe091b-b339-4474-80e5-dac6bca47fd2 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:06.925665 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbbe091b-b339-4474-80e5-dac6bca47fd2 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:06.926120 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbbe091b-b339-4474-80e5-dac6bca47fd2 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:06.926894 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbbe091b-b339-4474-80e5-dac6bca47fd2 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:06.927331 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bbbe091b-b339-4474-80e5-dac6bca47fd2 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:07.018077 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-84034943-3849-45cf-b4c4-4f3da0e22487 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:07.018783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-84034943-3849-45cf-b4c4-4f3da0e22487 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:07.028164 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-84034943-3849-45cf-b4c4-4f3da0e22487 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:07.028624 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-84034943-3849-45cf-b4c4-4f3da0e22487 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:07.029538 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-84034943-3849-45cf-b4c4-4f3da0e22487 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:07.029983 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-84034943-3849-45cf-b4c4-4f3da0e22487 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:07.082004 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bbbe091b-b339-4474-80e5-dac6bca47fd2 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:07.090754 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bbbe091b-b339-4474-80e5-dac6bca47fd2 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.176729 Jul 18 08:51:07.091262 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 309/612] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:06 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:07.177085 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-84034943-3849-45cf-b4c4-4f3da0e22487 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:07.179401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=100 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:07.186487 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-84034943-3849-45cf-b4c4-4f3da0e22487 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:07.189197 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-84034943-3849-45cf-b4c4-4f3da0e22487 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:07.189991 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-84034943-3849-45cf-b4c4-4f3da0e22487 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1408 microversion: 2.20 time: 0.176209 Jul 18 08:51:07.190569 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 304/613] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:51:07 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:51:07.586319 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6fa226be-7119-41e6-b1ab-e2248a20f69d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:07.586923 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6fa226be-7119-41e6-b1ab-e2248a20f69d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:07.593524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6fa226be-7119-41e6-b1ab-e2248a20f69d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:07.594715 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6fa226be-7119-41e6-b1ab-e2248a20f69d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:07.595487 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6fa226be-7119-41e6-b1ab-e2248a20f69d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:07.595952 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6fa226be-7119-41e6-b1ab-e2248a20f69d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:07.612837 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:07.982210 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6fa226be-7119-41e6-b1ab-e2248a20f69d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:07.990536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6fa226be-7119-41e6-b1ab-e2248a20f69d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1363 microversion: 2.1 time: 0.408186 Jul 18 08:51:07.991172 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 310/614] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:07 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:08.109068 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-70ba5451-6d39-4ebb-801b-7ad7c7d5eca8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:08.109906 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-70ba5451-6d39-4ebb-801b-7ad7c7d5eca8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:08.116596 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-70ba5451-6d39-4ebb-801b-7ad7c7d5eca8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:08.117044 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-70ba5451-6d39-4ebb-801b-7ad7c7d5eca8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:08.117832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-70ba5451-6d39-4ebb-801b-7ad7c7d5eca8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:08.118268 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-70ba5451-6d39-4ebb-801b-7ad7c7d5eca8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:08.208633 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1e5df838-ac45-46e4-8289-baadcb0b3d0b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:08.209236 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1e5df838-ac45-46e4-8289-baadcb0b3d0b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:08.215424 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1e5df838-ac45-46e4-8289-baadcb0b3d0b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:08.215927 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1e5df838-ac45-46e4-8289-baadcb0b3d0b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:08.216668 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1e5df838-ac45-46e4-8289-baadcb0b3d0b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:08.217102 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1e5df838-ac45-46e4-8289-baadcb0b3d0b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:08.279661 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-70ba5451-6d39-4ebb-801b-7ad7c7d5eca8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:08.288767 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-70ba5451-6d39-4ebb-801b-7ad7c7d5eca8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.183944 Jul 18 08:51:08.289682 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 305/615] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:08 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:08.383042 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1e5df838-ac45-46e4-8289-baadcb0b3d0b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:08.392111 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1e5df838-ac45-46e4-8289-baadcb0b3d0b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:08.393626 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1e5df838-ac45-46e4-8289-baadcb0b3d0b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:08.395028 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1e5df838-ac45-46e4-8289-baadcb0b3d0b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1600 microversion: 2.20 time: 0.191187 Jul 18 08:51:08.395440 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 311/616] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:51:08 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1600 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:51:08.414145 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c3aae827-8cf7-47f8-8fe2-c29270853241 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:08.414629 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c3aae827-8cf7-47f8-8fe2-c29270853241 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:08.420811 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c3aae827-8cf7-47f8-8fe2-c29270853241 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:08.421951 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c3aae827-8cf7-47f8-8fe2-c29270853241 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:08.422717 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c3aae827-8cf7-47f8-8fe2-c29270853241 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:08.423160 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c3aae827-8cf7-47f8-8fe2-c29270853241 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:08.507236 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c3aae827-8cf7-47f8-8fe2-c29270853241 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097093 Jul 18 08:51:08.508195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 306/617] 10.222.0.57 () {60 vars in 1315 bytes} [Mon Jul 18 08:51:08 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:51:09.008861 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6db97da1-131d-4bf1-8b54-54e9c075a3e7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:09.009593 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6db97da1-131d-4bf1-8b54-54e9c075a3e7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:09.016850 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6db97da1-131d-4bf1-8b54-54e9c075a3e7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:09.017386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6db97da1-131d-4bf1-8b54-54e9c075a3e7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:09.018260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6db97da1-131d-4bf1-8b54-54e9c075a3e7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:09.018737 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6db97da1-131d-4bf1-8b54-54e9c075a3e7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:09.241175 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6db97da1-131d-4bf1-8b54-54e9c075a3e7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:09.250303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6db97da1-131d-4bf1-8b54-54e9c075a3e7 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1363 microversion: 2.1 time: 0.245389 Jul 18 08:51:09.251225 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 312/618] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:09 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:09.307471 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c1c3a7bf-7926-4f82-8357-91454a12bd35 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:09.308127 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c1c3a7bf-7926-4f82-8357-91454a12bd35 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:09.315345 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1c3a7bf-7926-4f82-8357-91454a12bd35 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:09.315832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1c3a7bf-7926-4f82-8357-91454a12bd35 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:09.316640 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1c3a7bf-7926-4f82-8357-91454a12bd35 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:09.317128 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1c3a7bf-7926-4f82-8357-91454a12bd35 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:09.471099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c1c3a7bf-7926-4f82-8357-91454a12bd35 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:09.479053 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c1c3a7bf-7926-4f82-8357-91454a12bd35 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.176103 Jul 18 08:51:09.479639 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 307/619] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:09 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:09.616655 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-8e3617ee-8780-49bf-b6a7-be54c2487245 req-9c5ff79b-7119-49c8-aa0a-a4f3458652ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18040578-a916-4929-ae00-067b0441f8e7", "tag": "87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:09.625270 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-8e3617ee-8780-49bf-b6a7-be54c2487245 req-9c5ff79b-7119-49c8-aa0a-a4f3458652ca service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:09.625772 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-8e3617ee-8780-49bf-b6a7-be54c2487245 req-9c5ff79b-7119-49c8-aa0a-a4f3458652ca service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:09.636852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-8e3617ee-8780-49bf-b6a7-be54c2487245 req-9c5ff79b-7119-49c8-aa0a-a4f3458652ca service nova] Creating event network-changed:87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd for instance 18040578-a916-4929-ae00-067b0441f8e7 on hv-cinder-85014 Jul 18 08:51:09.643627 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-8e3617ee-8780-49bf-b6a7-be54c2487245 req-9c5ff79b-7119-49c8-aa0a-a4f3458652ca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030631 Jul 18 08:51:09.644350 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 313/620] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:10.267587 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e58f938f-05fe-4fbe-884c-c8fa6b16caab tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:10.268251 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e58f938f-05fe-4fbe-884c-c8fa6b16caab tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:10.275070 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e58f938f-05fe-4fbe-884c-c8fa6b16caab tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:10.276033 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e58f938f-05fe-4fbe-884c-c8fa6b16caab tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:10.276826 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e58f938f-05fe-4fbe-884c-c8fa6b16caab tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:10.277260 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e58f938f-05fe-4fbe-884c-c8fa6b16caab tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:10.433628 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e58f938f-05fe-4fbe-884c-c8fa6b16caab tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:10.442840 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e58f938f-05fe-4fbe-884c-c8fa6b16caab tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1363 microversion: 2.1 time: 0.180117 Jul 18 08:51:10.443438 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 308/621] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:10 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:10.488685 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-9ba03721-9ced-49dd-9210-9592935c8df7 req-c300782a-2ce2-41a7-8c22-964f2a640806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7d6682-c259-49a3-b61d-46ac98ff9948", "name": "network-vif-plugged", "status": "completed", "tag": "5a31bcdc-6257-4e32-bc32-f336670e10fd"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:10.497284 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0ecba64c-091b-40ef-ba21-962917b5d078 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:10.497896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0ecba64c-091b-40ef-ba21-962917b5d078 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:10.498310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-9ba03721-9ced-49dd-9210-9592935c8df7 req-c300782a-2ce2-41a7-8c22-964f2a640806 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:10.498833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-9ba03721-9ced-49dd-9210-9592935c8df7 req-c300782a-2ce2-41a7-8c22-964f2a640806 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:10.501143 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:10.506352 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ecba64c-091b-40ef-ba21-962917b5d078 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:10.511168 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ecba64c-091b-40ef-ba21-962917b5d078 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:10.511168 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ecba64c-091b-40ef-ba21-962917b5d078 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:10.511168 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ecba64c-091b-40ef-ba21-962917b5d078 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:10.512928 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=12 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:10.513152 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-9ba03721-9ced-49dd-9210-9592935c8df7 req-c300782a-2ce2-41a7-8c22-964f2a640806 service nova] Creating event network-vif-plugged:5a31bcdc-6257-4e32-bc32-f336670e10fd for instance fb7d6682-c259-49a3-b61d-46ac98ff9948 on hv-cinder-85014 Jul 18 08:51:10.519357 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-9ba03721-9ced-49dd-9210-9592935c8df7 req-c300782a-2ce2-41a7-8c22-964f2a640806 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036296 Jul 18 08:51:10.520065 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 314/622] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:10.726059 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0ecba64c-091b-40ef-ba21-962917b5d078 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:10.734904 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0ecba64c-091b-40ef-ba21-962917b5d078 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.241508 Jul 18 08:51:10.735489 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 309/623] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:10 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:11.457610 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=12 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:11.461656 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-34df3008-3091-48e6-9d0b-84b8f6020660 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:11.462423 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-34df3008-3091-48e6-9d0b-84b8f6020660 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:11.469224 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-34df3008-3091-48e6-9d0b-84b8f6020660 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:11.469708 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-34df3008-3091-48e6-9d0b-84b8f6020660 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:11.470478 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-34df3008-3091-48e6-9d0b-84b8f6020660 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:11.470918 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-34df3008-3091-48e6-9d0b-84b8f6020660 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:11.613540 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-34df3008-3091-48e6-9d0b-84b8f6020660 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:11.621477 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-34df3008-3091-48e6-9d0b-84b8f6020660 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1363 microversion: 2.1 time: 0.164790 Jul 18 08:51:11.622075 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 315/624] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:11 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:11.754129 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d2eddf8a-a220-472a-b832-cd245ebce67f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:11.754658 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d2eddf8a-a220-472a-b832-cd245ebce67f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:11.761411 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2eddf8a-a220-472a-b832-cd245ebce67f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:11.761861 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2eddf8a-a220-472a-b832-cd245ebce67f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:11.762635 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2eddf8a-a220-472a-b832-cd245ebce67f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:11.763074 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2eddf8a-a220-472a-b832-cd245ebce67f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:11.954141 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d2eddf8a-a220-472a-b832-cd245ebce67f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:11.963106 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d2eddf8a-a220-472a-b832-cd245ebce67f tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.212945 Jul 18 08:51:11.963731 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 310/625] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:11 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:12.638712 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-acd2259a-fc1a-41d6-b25e-af92a998873c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:12.639435 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-acd2259a-fc1a-41d6-b25e-af92a998873c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:12.646775 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-acd2259a-fc1a-41d6-b25e-af92a998873c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:12.647391 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-acd2259a-fc1a-41d6-b25e-af92a998873c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:12.648315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-acd2259a-fc1a-41d6-b25e-af92a998873c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:12.648829 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-acd2259a-fc1a-41d6-b25e-af92a998873c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:12.785372 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-acd2259a-fc1a-41d6-b25e-af92a998873c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:12.793458 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-acd2259a-fc1a-41d6-b25e-af92a998873c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1550 microversion: 2.1 time: 0.158651 Jul 18 08:51:12.794037 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 316/626] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:12 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:12.810262 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-81c3e565-af94-42aa-91ec-c26b96e32840 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:12.810830 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-81c3e565-af94-42aa-91ec-c26b96e32840 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:12.819250 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-81c3e565-af94-42aa-91ec-c26b96e32840 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:12.819743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-81c3e565-af94-42aa-91ec-c26b96e32840 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:12.820568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-81c3e565-af94-42aa-91ec-c26b96e32840 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:12.821039 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-81c3e565-af94-42aa-91ec-c26b96e32840 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:12.901586 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-81c3e565-af94-42aa-91ec-c26b96e32840 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095175 Jul 18 08:51:12.902180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 311/627] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 08:51:12 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:12.987255 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-68f824db-2125-430d-b0c6-026aa42a5485 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:12.988423 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-68f824db-2125-430d-b0c6-026aa42a5485 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:12.996934 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-68f824db-2125-430d-b0c6-026aa42a5485 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:13.000886 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-68f824db-2125-430d-b0c6-026aa42a5485 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:13.000886 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-68f824db-2125-430d-b0c6-026aa42a5485 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:13.000886 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-68f824db-2125-430d-b0c6-026aa42a5485 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:13.188112 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-68f824db-2125-430d-b0c6-026aa42a5485 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:13.201474 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-68f824db-2125-430d-b0c6-026aa42a5485 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1756 microversion: 2.1 time: 0.223348 Jul 18 08:51:13.202402 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 317/628] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:12 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:14.057078 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-068c27d2-4b0e-4078-b839-527e0b16d53b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:14.057676 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-068c27d2-4b0e-4078-b839-527e0b16d53b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:14.065137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-068c27d2-4b0e-4078-b839-527e0b16d53b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:14.065587 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-068c27d2-4b0e-4078-b839-527e0b16d53b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:14.066369 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-068c27d2-4b0e-4078-b839-527e0b16d53b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:14.066804 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-068c27d2-4b0e-4078-b839-527e0b16d53b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:14.091062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-068c27d2-4b0e-4078-b839-527e0b16d53b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/ips" status: 200 len: 150 microversion: 2.1 time: 0.038479 Jul 18 08:51:14.091617 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 312/629] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 08:51:14 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:14.219570 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bd5346c6-98fc-4b4a-bb67-cf2414047077 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:14.220303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bd5346c6-98fc-4b4a-bb67-cf2414047077 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:14.222852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:14.227646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd5346c6-98fc-4b4a-bb67-cf2414047077 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:14.228123 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd5346c6-98fc-4b4a-bb67-cf2414047077 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:14.229060 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd5346c6-98fc-4b4a-bb67-cf2414047077 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:14.229490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd5346c6-98fc-4b4a-bb67-cf2414047077 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:14.299951 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-8fd452c9-6a45-4130-9777-656292c5bc64 req-33cf3b69-fd48-4b5c-8fb8-69544b99c1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7d6682-c259-49a3-b61d-46ac98ff9948", "tag": "5a31bcdc-6257-4e32-bc32-f336670e10fd"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:14.312106 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-8fd452c9-6a45-4130-9777-656292c5bc64 req-33cf3b69-fd48-4b5c-8fb8-69544b99c1c1 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:14.313073 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-8fd452c9-6a45-4130-9777-656292c5bc64 req-33cf3b69-fd48-4b5c-8fb8-69544b99c1c1 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:14.331244 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-8fd452c9-6a45-4130-9777-656292c5bc64 req-33cf3b69-fd48-4b5c-8fb8-69544b99c1c1 service nova] Creating event network-changed:5a31bcdc-6257-4e32-bc32-f336670e10fd for instance fb7d6682-c259-49a3-b61d-46ac98ff9948 on hv-cinder-85014 Jul 18 08:51:14.336499 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-8fd452c9-6a45-4130-9777-656292c5bc64 req-33cf3b69-fd48-4b5c-8fb8-69544b99c1c1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041840 Jul 18 08:51:14.337743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 313/630] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:51:14.395220 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bd5346c6-98fc-4b4a-bb67-cf2414047077 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:14.404576 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bd5346c6-98fc-4b4a-bb67-cf2414047077 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1759 microversion: 2.1 time: 0.189019 Jul 18 08:51:14.406037 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 318/631] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:14 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1759 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:15.802738 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e949021d-fc5c-4302-a976-f9e5eed2bee6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87ea8bcc-92a2-44bf-9357-f20e31dfff92"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:15.803998 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e949021d-fc5c-4302-a976-f9e5eed2bee6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:15.810263 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e949021d-fc5c-4302-a976-f9e5eed2bee6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:15.810715 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e949021d-fc5c-4302-a976-f9e5eed2bee6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:15.811472 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e949021d-fc5c-4302-a976-f9e5eed2bee6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:15.812559 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e949021d-fc5c-4302-a976-f9e5eed2bee6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:16.637506 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e949021d-fc5c-4302-a976-f9e5eed2bee6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.839413 Jul 18 08:51:16.638116 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 314/632] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:51:15 2022] POST /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments => generated 194 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:23.540431 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-fd44781b-1a32-448f-8305-201bb2e967bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:23.541026 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-fd44781b-1a32-448f-8305-201bb2e967bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:23.548873 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fd44781b-1a32-448f-8305-201bb2e967bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:23.549394 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fd44781b-1a32-448f-8305-201bb2e967bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:23.550100 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fd44781b-1a32-448f-8305-201bb2e967bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:23.550538 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fd44781b-1a32-448f-8305-201bb2e967bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:23.642196 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-fd44781b-1a32-448f-8305-201bb2e967bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lazy-loading 'services' on Instance uuid f3d75586-3142-49ba-b48b-9db088664de7 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:51:23.888255 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-fd44781b-1a32-448f-8305-201bb2e967bd tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments/d000b557-42bb-4852-9715-319381597a1e" status: 202 len: 0 microversion: 2.1 time: 0.351459 Jul 18 08:51:23.888966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 319/633] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:51:23 2022] DELETE /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments/d000b557-42bb-4852-9715-319381597a1e => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:51:23.900191 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-057e5a14-f12d-46e6-a6e8-8b20814efc50 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:23.901212 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-057e5a14-f12d-46e6-a6e8-8b20814efc50 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:23.908729 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-057e5a14-f12d-46e6-a6e8-8b20814efc50 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:23.909415 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-057e5a14-f12d-46e6-a6e8-8b20814efc50 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:23.910305 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-057e5a14-f12d-46e6-a6e8-8b20814efc50 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:23.910904 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-057e5a14-f12d-46e6-a6e8-8b20814efc50 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:23.953548 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-057e5a14-f12d-46e6-a6e8-8b20814efc50 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058687 Jul 18 08:51:23.957086 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 315/634] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:51:23 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:51:24.239049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-66bf4e15-781c-4e79-b126-558d1c960ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87ea8bcc-92a2-44bf-9357-f20e31dfff92"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:24.240273 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-66bf4e15-781c-4e79-b126-558d1c960ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:24.246605 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66bf4e15-781c-4e79-b126-558d1c960ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:24.247050 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66bf4e15-781c-4e79-b126-558d1c960ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:24.247848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66bf4e15-781c-4e79-b126-558d1c960ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:24.252975 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66bf4e15-781c-4e79-b126-558d1c960ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:24.383380 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-66bf4e15-781c-4e79-b126-558d1c960ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Invalid volume: volume 87ea8bcc-92a2-44bf-9357-f20e31dfff92 is already attached to instances: b503f6b2-890d-41b0-9323-5af163d8a016 Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-66bf4e15-781c-4e79-b126-558d1c960ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: POST /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments HTTP/1.1 Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 74 Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:51:24.384106 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {"volumeAttachment": {"volumeId": "87ea8bcc-92a2-44bf-9357-f20e31dfff92"}} Jul 18 08:51:24.385533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Invalid volume: volume 87ea8bcc-92a2-44bf-9357-f20e31dfff92 is already attached to instances: b503f6b2-890d-41b0-9323-5af163d8a016 Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'server_id': 'b503f6b2-890d-41b0-9323-5af163d8a016', 'body': {'volumeAttachment': {'volumeId': '87ea8bcc-92a2-44bf-9357-f20e31dfff92'}}} Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 87ea8bcc-92a2-44bf-9357-f20e31dfff92 is already attached to instances: b503f6b2-890d-41b0-9323-5af163d8a016 Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:51:24.386456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 87ea8bcc-92a2-44bf-9357-f20e31dfff92 is already attached to instances: b503f6b2-890d-41b0-9323-5af163d8a016 Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:24.388163 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:51:24.389833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:51:24.389833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:51:24.389833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:51:24.389833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 87ea8bcc-92a2-44bf-9357-f20e31dfff92 is already attached to instances: b503f6b2-890d-41b0-9323-5af163d8a016 Jul 18 08:51:24.389833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:51:24.389833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-66bf4e15-781c-4e79-b126-558d1c960ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 400 to user: Invalid volume: volume 87ea8bcc-92a2-44bf-9357-f20e31dfff92 is already attached to instances: b503f6b2-890d-41b0-9323-5af163d8a016 {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:51:24.389833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-66bf4e15-781c-4e79-b126-558d1c960ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.151440 Jul 18 08:51:24.389833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 320/635] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:51:24 2022] POST /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments => generated 174 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 08:51:24.450280 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a00777f1-f69b-475e-954c-e96aa4206046 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:24.450822 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a00777f1-f69b-475e-954c-e96aa4206046 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:24.457738 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a00777f1-f69b-475e-954c-e96aa4206046 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:24.458119 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a00777f1-f69b-475e-954c-e96aa4206046 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:24.458896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a00777f1-f69b-475e-954c-e96aa4206046 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:24.459401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a00777f1-f69b-475e-954c-e96aa4206046 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:24.601167 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-a00777f1-f69b-475e-954c-e96aa4206046 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lazy-loading 'services' on Instance uuid b503f6b2-890d-41b0-9323-5af163d8a016 {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:51:24.867446 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a00777f1-f69b-475e-954c-e96aa4206046 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments/87ea8bcc-92a2-44bf-9357-f20e31dfff92" status: 202 len: 0 microversion: 2.1 time: 0.421195 Jul 18 08:51:24.868067 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 316/636] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:51:24 2022] DELETE /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments/87ea8bcc-92a2-44bf-9357-f20e31dfff92 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:51:24.878056 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-dda2486b-21b0-478f-97b0-302c477d92fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:24.878994 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-dda2486b-21b0-478f-97b0-302c477d92fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:24.886598 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dda2486b-21b0-478f-97b0-302c477d92fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:24.887047 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dda2486b-21b0-478f-97b0-302c477d92fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:24.887878 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dda2486b-21b0-478f-97b0-302c477d92fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:24.888346 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dda2486b-21b0-478f-97b0-302c477d92fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:24.919089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-dda2486b-21b0-478f-97b0-302c477d92fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Jul 18 08:51:24.919644 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 321/637] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:51:24 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:51:24.967970 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-acd965c3-fe22-46dd-8f7c-d27de0fd7c91 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:24.969054 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-acd965c3-fe22-46dd-8f7c-d27de0fd7c91 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:24.977560 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-acd965c3-fe22-46dd-8f7c-d27de0fd7c91 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:24.978016 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-acd965c3-fe22-46dd-8f7c-d27de0fd7c91 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:24.978797 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-acd965c3-fe22-46dd-8f7c-d27de0fd7c91 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:24.979241 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-acd965c3-fe22-46dd-8f7c-d27de0fd7c91 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:25.021291 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-acd965c3-fe22-46dd-8f7c-d27de0fd7c91 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057765 Jul 18 08:51:25.022251 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 317/638] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:51:24 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:25.931063 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c6d8d058-5aac-48de-aa56-4b0ff09ae531 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:25.932017 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c6d8d058-5aac-48de-aa56-4b0ff09ae531 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:25.938544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c6d8d058-5aac-48de-aa56-4b0ff09ae531 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:25.939015 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c6d8d058-5aac-48de-aa56-4b0ff09ae531 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:25.940325 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c6d8d058-5aac-48de-aa56-4b0ff09ae531 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:25.940922 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c6d8d058-5aac-48de-aa56-4b0ff09ae531 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:25.971635 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c6d8d058-5aac-48de-aa56-4b0ff09ae531 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044319 Jul 18 08:51:25.972340 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 322/639] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:51:25 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:26.037358 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ae9f1ae0-0e3b-4848-9500-a28671e7b240 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:26.038283 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ae9f1ae0-0e3b-4848-9500-a28671e7b240 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:26.044766 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ae0-0e3b-4848-9500-a28671e7b240 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:26.045201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ae0-0e3b-4848-9500-a28671e7b240 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:26.045965 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ae0-0e3b-4848-9500-a28671e7b240 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:26.046402 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ae9f1ae0-0e3b-4848-9500-a28671e7b240 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:26.078422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ae9f1ae0-0e3b-4848-9500-a28671e7b240 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045024 Jul 18 08:51:26.079014 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 318/640] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:51:26 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 08:51:26.153602 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3d55e8d4-14ae-47ae-b6d4-021a1e1ee43a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:26.154125 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-3d55e8d4-14ae-47ae-b6d4-021a1e1ee43a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:26.160801 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3d55e8d4-14ae-47ae-b6d4-021a1e1ee43a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:26.161246 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3d55e8d4-14ae-47ae-b6d4-021a1e1ee43a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:26.162038 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3d55e8d4-14ae-47ae-b6d4-021a1e1ee43a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:26.162474 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3d55e8d4-14ae-47ae-b6d4-021a1e1ee43a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:26.189478 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-3d55e8d4-14ae-47ae-b6d4-021a1e1ee43a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:51:26.531200 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-3d55e8d4-14ae-47ae-b6d4-021a1e1ee43a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 204 len: 0 microversion: 2.1 time: 0.381086 Jul 18 08:51:26.532013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 323/641] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:51:26 2022] DELETE /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:51:26.541692 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8c27c6bd-88c1-4d61-8be4-4b8747ac368f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:26.542305 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8c27c6bd-88c1-4d61-8be4-4b8747ac368f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:26.548575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8c27c6bd-88c1-4d61-8be4-4b8747ac368f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:26.549048 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8c27c6bd-88c1-4d61-8be4-4b8747ac368f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:26.551217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8c27c6bd-88c1-4d61-8be4-4b8747ac368f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:26.551662 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8c27c6bd-88c1-4d61-8be4-4b8747ac368f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:26.683638 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-8c27c6bd-88c1-4d61-8be4-4b8747ac368f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:26.691815 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8c27c6bd-88c1-4d61-8be4-4b8747ac368f tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1688 microversion: 2.1 time: 0.154109 Jul 18 08:51:26.692394 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 319/642] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:26 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:26.984022 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-886776a4-a315-4b2e-b229-55f5141e1ac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:26.984982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-886776a4-a315-4b2e-b229-55f5141e1ac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:26.992346 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-886776a4-a315-4b2e-b229-55f5141e1ac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:26.992793 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-886776a4-a315-4b2e-b229-55f5141e1ac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:26.993559 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-886776a4-a315-4b2e-b229-55f5141e1ac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:26.993994 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-886776a4-a315-4b2e-b229-55f5141e1ac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:27.024758 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-886776a4-a315-4b2e-b229-55f5141e1ac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045173 Jul 18 08:51:27.025313 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 324/643] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:51:26 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 08:51:27.084862 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-37a5503a-1445-43aa-b947-709272041ef6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:27.085693 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-37a5503a-1445-43aa-b947-709272041ef6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:27.092020 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-37a5503a-1445-43aa-b947-709272041ef6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:27.092467 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-37a5503a-1445-43aa-b947-709272041ef6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:27.093236 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-37a5503a-1445-43aa-b947-709272041ef6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:27.093674 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-37a5503a-1445-43aa-b947-709272041ef6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:27.119770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-37a5503a-1445-43aa-b947-709272041ef6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Going to try to terminate instance {{(pid=124895) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:51:27.134208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:27.422341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-37a5503a-1445-43aa-b947-709272041ef6 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 204 len: 0 microversion: 2.1 time: 0.341722 Jul 18 08:51:27.422872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 320/644] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:51:27 2022] DELETE /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:51:27.431636 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3dbf2e83-f109-4437-aa3e-76150be4dffb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:27.432392 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-3dbf2e83-f109-4437-aa3e-76150be4dffb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:27.438566 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3dbf2e83-f109-4437-aa3e-76150be4dffb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:27.439019 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3dbf2e83-f109-4437-aa3e-76150be4dffb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:27.440300 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3dbf2e83-f109-4437-aa3e-76150be4dffb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:27.440740 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3dbf2e83-f109-4437-aa3e-76150be4dffb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:27.572832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-3dbf2e83-f109-4437-aa3e-76150be4dffb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:27.580544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-3dbf2e83-f109-4437-aa3e-76150be4dffb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1683 microversion: 2.1 time: 0.152761 Jul 18 08:51:27.581113 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 325/645] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:27 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:27.709072 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2f8c961f-109e-4142-89a0-06f2171ee170 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:27.709759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2f8c961f-109e-4142-89a0-06f2171ee170 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:27.715752 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f8c961f-109e-4142-89a0-06f2171ee170 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:27.716196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f8c961f-109e-4142-89a0-06f2171ee170 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:27.716947 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f8c961f-109e-4142-89a0-06f2171ee170 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:27.717376 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f8c961f-109e-4142-89a0-06f2171ee170 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:27.853722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2f8c961f-109e-4142-89a0-06f2171ee170 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:27.861148 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2f8c961f-109e-4142-89a0-06f2171ee170 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1688 microversion: 2.1 time: 0.156468 Jul 18 08:51:27.862213 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 321/646] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:27 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:28.598577 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-65a3b953-c67f-4ac7-ba45-06f42efcbb0b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:28.599221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-65a3b953-c67f-4ac7-ba45-06f42efcbb0b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:28.606009 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-65a3b953-c67f-4ac7-ba45-06f42efcbb0b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:28.606465 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-65a3b953-c67f-4ac7-ba45-06f42efcbb0b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:28.607252 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-65a3b953-c67f-4ac7-ba45-06f42efcbb0b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:28.607714 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-65a3b953-c67f-4ac7-ba45-06f42efcbb0b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:28.610710 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:28.750591 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-65a3b953-c67f-4ac7-ba45-06f42efcbb0b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:28.758403 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-65a3b953-c67f-4ac7-ba45-06f42efcbb0b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1683 microversion: 2.1 time: 0.164423 Jul 18 08:51:28.758973 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 326/647] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:28 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:28.878631 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3dd305fd-45b3-4cf7-a809-549f7ad61f96 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:28.879179 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3dd305fd-45b3-4cf7-a809-549f7ad61f96 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:28.885736 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3dd305fd-45b3-4cf7-a809-549f7ad61f96 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:28.886181 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3dd305fd-45b3-4cf7-a809-549f7ad61f96 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:28.886943 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3dd305fd-45b3-4cf7-a809-549f7ad61f96 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:28.887367 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3dd305fd-45b3-4cf7-a809-549f7ad61f96 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:29.019827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3dd305fd-45b3-4cf7-a809-549f7ad61f96 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:29.027812 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3dd305fd-45b3-4cf7-a809-549f7ad61f96 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1688 microversion: 2.1 time: 0.152999 Jul 18 08:51:29.028393 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 322/648] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:28 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:29.775910 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d7cad537-d9d0-489b-9b87-deedfad86c0c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:29.776519 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d7cad537-d9d0-489b-9b87-deedfad86c0c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:29.783169 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d7cad537-d9d0-489b-9b87-deedfad86c0c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:29.783655 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d7cad537-d9d0-489b-9b87-deedfad86c0c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:29.784552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d7cad537-d9d0-489b-9b87-deedfad86c0c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:29.784982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d7cad537-d9d0-489b-9b87-deedfad86c0c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:29.917944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d7cad537-d9d0-489b-9b87-deedfad86c0c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:29.925899 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d7cad537-d9d0-489b-9b87-deedfad86c0c tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1683 microversion: 2.1 time: 0.153939 Jul 18 08:51:29.926493 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 327/649] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:29 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:30.045208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d3f37499-dfd2-4624-8066-c0ef83c57817 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:30.045817 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d3f37499-dfd2-4624-8066-c0ef83c57817 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:30.054526 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d3f37499-dfd2-4624-8066-c0ef83c57817 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:30.057479 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d3f37499-dfd2-4624-8066-c0ef83c57817 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:30.057479 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d3f37499-dfd2-4624-8066-c0ef83c57817 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:30.057479 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d3f37499-dfd2-4624-8066-c0ef83c57817 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:30.197954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d3f37499-dfd2-4624-8066-c0ef83c57817 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:30.205972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d3f37499-dfd2-4624-8066-c0ef83c57817 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1688 microversion: 2.1 time: 0.164541 Jul 18 08:51:30.206558 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 323/650] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:30 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:30.943557 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-fa6f7ffc-d0c3-47f3-ad45-e25963ae500b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:30.944176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-fa6f7ffc-d0c3-47f3-ad45-e25963ae500b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:30.950853 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fa6f7ffc-d0c3-47f3-ad45-e25963ae500b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:30.951245 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fa6f7ffc-d0c3-47f3-ad45-e25963ae500b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:30.952039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fa6f7ffc-d0c3-47f3-ad45-e25963ae500b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:30.952734 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fa6f7ffc-d0c3-47f3-ad45-e25963ae500b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:31.083256 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-fa6f7ffc-d0c3-47f3-ad45-e25963ae500b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:31.097022 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-fa6f7ffc-d0c3-47f3-ad45-e25963ae500b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1683 microversion: 2.1 time: 0.151731 Jul 18 08:51:31.097022 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 328/651] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:30 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:31.223555 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-141e06bd-56c6-45f8-bf3c-97bb0fef44eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:31.224216 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-141e06bd-56c6-45f8-bf3c-97bb0fef44eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:31.230691 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-141e06bd-56c6-45f8-bf3c-97bb0fef44eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:31.231129 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-141e06bd-56c6-45f8-bf3c-97bb0fef44eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:31.231922 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-141e06bd-56c6-45f8-bf3c-97bb0fef44eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:31.232359 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-141e06bd-56c6-45f8-bf3c-97bb0fef44eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:31.363581 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-141e06bd-56c6-45f8-bf3c-97bb0fef44eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:31.371130 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-141e06bd-56c6-45f8-bf3c-97bb0fef44eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1688 microversion: 2.1 time: 0.151704 Jul 18 08:51:31.371805 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 324/652] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:31 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:32.109077 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ce4d0f3d-d19e-4eda-bf48-abe721be8ded tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:32.109620 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ce4d0f3d-d19e-4eda-bf48-abe721be8ded tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:32.116419 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce4d0f3d-d19e-4eda-bf48-abe721be8ded tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:32.122883 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce4d0f3d-d19e-4eda-bf48-abe721be8ded tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:32.122883 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce4d0f3d-d19e-4eda-bf48-abe721be8ded tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:32.122883 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce4d0f3d-d19e-4eda-bf48-abe721be8ded tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:32.252142 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ce4d0f3d-d19e-4eda-bf48-abe721be8ded tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:32.259987 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ce4d0f3d-d19e-4eda-bf48-abe721be8ded tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1683 microversion: 2.1 time: 0.154902 Jul 18 08:51:32.260563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 329/653] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:32 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:32.388864 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0a1f2600-2ef6-4cda-9aa5-1df5b747f1b4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:32.389479 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0a1f2600-2ef6-4cda-9aa5-1df5b747f1b4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:32.396911 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0a1f2600-2ef6-4cda-9aa5-1df5b747f1b4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:32.397360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0a1f2600-2ef6-4cda-9aa5-1df5b747f1b4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:32.398142 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0a1f2600-2ef6-4cda-9aa5-1df5b747f1b4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:32.398582 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0a1f2600-2ef6-4cda-9aa5-1df5b747f1b4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:32.605900 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0a1f2600-2ef6-4cda-9aa5-1df5b747f1b4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:32.614038 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0a1f2600-2ef6-4cda-9aa5-1df5b747f1b4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1688 microversion: 2.1 time: 0.229026 Jul 18 08:51:32.614951 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 325/654] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:32 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1688 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:33.244733 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-641f70ee-3dea-448c-a12e-055d69f550c3 req-33f63881-d3c7-4902-b46f-ed0af2f47ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d75586-3142-49ba-b48b-9db088664de7", "name": "network-vif-deleted", "tag": "098eed33-e2bd-493f-826e-a819152c71b1"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:33.253304 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-641f70ee-3dea-448c-a12e-055d69f550c3 req-33f63881-d3c7-4902-b46f-ed0af2f47ed7 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:33.253753 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-641f70ee-3dea-448c-a12e-055d69f550c3 req-33f63881-d3c7-4902-b46f-ed0af2f47ed7 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:33.265461 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-641f70ee-3dea-448c-a12e-055d69f550c3 req-33f63881-d3c7-4902-b46f-ed0af2f47ed7 service nova] Creating event network-vif-deleted:098eed33-e2bd-493f-826e-a819152c71b1 for instance f3d75586-3142-49ba-b48b-9db088664de7 on hv-cinder-85014 Jul 18 08:51:33.270810 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-641f70ee-3dea-448c-a12e-055d69f550c3 req-33f63881-d3c7-4902-b46f-ed0af2f47ed7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029709 Jul 18 08:51:33.271605 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 330/655] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:33.279947 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5bd8bdef-1ee9-4cae-aaa9-b098b330ffac tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:33.280640 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5bd8bdef-1ee9-4cae-aaa9-b098b330ffac tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:33.288007 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5bd8bdef-1ee9-4cae-aaa9-b098b330ffac tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:33.294599 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5bd8bdef-1ee9-4cae-aaa9-b098b330ffac tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:33.294599 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5bd8bdef-1ee9-4cae-aaa9-b098b330ffac tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:33.294599 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5bd8bdef-1ee9-4cae-aaa9-b098b330ffac tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:33.374719 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5bd8bdef-1ee9-4cae-aaa9-b098b330ffac tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:33.383861 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5bd8bdef-1ee9-4cae-aaa9-b098b330ffac tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1615 microversion: 2.1 time: 0.109682 Jul 18 08:51:33.385005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 326/656] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:33 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1615 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:33.542975 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-0bce9a81-1691-4eee-b3a1-8e30fd5162f7 req-c8a9ae47-9902-4ef4-ae14-9be65b1f9348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b503f6b2-890d-41b0-9323-5af163d8a016", "name": "network-vif-deleted", "tag": "c9bbf27b-9770-4d9c-8c89-bef4da1b48d3"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:33.573951 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-0bce9a81-1691-4eee-b3a1-8e30fd5162f7 req-c8a9ae47-9902-4ef4-ae14-9be65b1f9348 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:33.575961 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-0bce9a81-1691-4eee-b3a1-8e30fd5162f7 req-c8a9ae47-9902-4ef4-ae14-9be65b1f9348 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:33.593751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-0bce9a81-1691-4eee-b3a1-8e30fd5162f7 req-c8a9ae47-9902-4ef4-ae14-9be65b1f9348 service nova] Creating event network-vif-deleted:c9bbf27b-9770-4d9c-8c89-bef4da1b48d3 for instance b503f6b2-890d-41b0-9323-5af163d8a016 on hv-cinder-85014 Jul 18 08:51:33.600986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-0bce9a81-1691-4eee-b3a1-8e30fd5162f7 req-c8a9ae47-9902-4ef4-ae14-9be65b1f9348 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062867 Jul 18 08:51:33.602982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 331/657] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:33.630469 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9c314de0-5ffb-4400-aab4-8d0c5ac29d37 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:33.631093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9c314de0-5ffb-4400-aab4-8d0c5ac29d37 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:33.638578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9c314de0-5ffb-4400-aab4-8d0c5ac29d37 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:33.639383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9c314de0-5ffb-4400-aab4-8d0c5ac29d37 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:33.640525 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9c314de0-5ffb-4400-aab4-8d0c5ac29d37 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:33.641443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9c314de0-5ffb-4400-aab4-8d0c5ac29d37 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:33.690162 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9c314de0-5ffb-4400-aab4-8d0c5ac29d37 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:33.691239 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9c314de0-5ffb-4400-aab4-8d0c5ac29d37 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:33.691965 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-9c314de0-5ffb-4400-aab4-8d0c5ac29d37 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lazy-loading 'fault' on Instance uuid f3d75586-3142-49ba-b48b-9db088664de7 {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:51:33.753802 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9c314de0-5ffb-4400-aab4-8d0c5ac29d37 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:33.763792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9c314de0-5ffb-4400-aab4-8d0c5ac29d37 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 200 len: 1334 microversion: 2.1 time: 0.137145 Jul 18 08:51:33.764762 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 327/658] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:33 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 1334 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:34.406550 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d8d08940-54e1-4362-88b8-fc1dbcb65cd8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:34.410832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d8d08940-54e1-4362-88b8-fc1dbcb65cd8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:34.422714 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d8d08940-54e1-4362-88b8-fc1dbcb65cd8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:34.423438 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d8d08940-54e1-4362-88b8-fc1dbcb65cd8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:34.425715 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d8d08940-54e1-4362-88b8-fc1dbcb65cd8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:34.426915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d8d08940-54e1-4362-88b8-fc1dbcb65cd8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:34.470743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d8d08940-54e1-4362-88b8-fc1dbcb65cd8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:34.471652 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d8d08940-54e1-4362-88b8-fc1dbcb65cd8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:34.472243 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-d8d08940-54e1-4362-88b8-fc1dbcb65cd8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lazy-loading 'fault' on Instance uuid b503f6b2-890d-41b0-9323-5af163d8a016 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:51:34.521662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d8d08940-54e1-4362-88b8-fc1dbcb65cd8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:34.530908 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d8d08940-54e1-4362-88b8-fc1dbcb65cd8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 200 len: 1332 microversion: 2.1 time: 0.132814 Jul 18 08:51:34.531901 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 332/659] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:34 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:34.786720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a913f19c-9e8a-480d-b08f-ebb41dcb2fc3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:34.787512 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a913f19c-9e8a-480d-b08f-ebb41dcb2fc3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: f3d75586-3142-49ba-b48b-9db088664de7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:34.794834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a913f19c-9e8a-480d-b08f-ebb41dcb2fc3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:34.795382 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a913f19c-9e8a-480d-b08f-ebb41dcb2fc3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:34.796215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a913f19c-9e8a-480d-b08f-ebb41dcb2fc3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:34.796656 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a913f19c-9e8a-480d-b08f-ebb41dcb2fc3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:34.812151 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-a913f19c-9e8a-480d-b08f-ebb41dcb2fc3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] HTTP exception thrown: Instance f3d75586-3142-49ba-b48b-9db088664de7 could not be found. Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a913f19c-9e8a-480d-b08f-ebb41dcb2fc3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Request method failure captured: Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 HTTP/1.1 Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3dPNM7loaJvWicYRxKNa0h2dELfsNCPBqGOVbM4VjyGgJ8YI3dpOKCRIG5ADhj0bk2Bwryh-K90h_Jd2S_dfzg6t89cOJ8oymbW0JrDzOPUwdA8pKjvNq7gMlvwLqdNYbV-dQFiRSW1qJ2dH3Y8KvvCxUHLV49BOovZ4stJNLcNu8 Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: c2f44b51cc624637bccd9ed1d3b1a769 Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:51:34.813849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2f44b51cc624637bccd9ed1d3b1a769", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: c2f44b51cc624637bccd9ed1d3b1a769 Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-ServerRescueNegativeTestJSON-220645641-project Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 56b3d8d145d94b358c86345eb5c3b306 Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-ServerRescueNegativeTestJSON-220645641-project Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance f3d75586-3142-49ba-b48b-9db088664de7 could not be found. Jul 18 08:51:34.815481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'f3d75586-3142-49ba-b48b-9db088664de7'} Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d75586-3142-49ba-b48b-9db088664de7 could not be found. Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:51:34.816320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d75586-3142-49ba-b48b-9db088664de7 could not be found. Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d75586-3142-49ba-b48b-9db088664de7 could not be found. Jul 18 08:51:34.817568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:34.818788 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a913f19c-9e8a-480d-b08f-ebb41dcb2fc3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Returning 404 to user: Instance f3d75586-3142-49ba-b48b-9db088664de7 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:51:34.818788 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a913f19c-9e8a-480d-b08f-ebb41dcb2fc3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7" status: 404 len: 111 microversion: 2.1 time: 0.033585 Jul 18 08:51:34.818788 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 328/660] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:34 2022] GET /compute/v2.1/servers/f3d75586-3142-49ba-b48b-9db088664de7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:51:34.824644 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-91ba310b-2f8a-482b-a56e-60a28f7dcd63 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '.version_select at 0x7fafb712e700>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:34.931942 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-91ba310b-2f8a-482b-a56e-60a28f7dcd63 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318404474" status: 202 len: 0 microversion: 2.1 time: 0.110942 Jul 18 08:51:34.932738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 333/661] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 08:51:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318404474 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 08:51:35.552267 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e85fb4cd-d4f8-4c47-8d83-ddc6ebd4fde2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:35.553121 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e85fb4cd-d4f8-4c47-8d83-ddc6ebd4fde2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:35.559748 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e85fb4cd-d4f8-4c47-8d83-ddc6ebd4fde2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:35.560449 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e85fb4cd-d4f8-4c47-8d83-ddc6ebd4fde2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:35.561440 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e85fb4cd-d4f8-4c47-8d83-ddc6ebd4fde2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:35.561889 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e85fb4cd-d4f8-4c47-8d83-ddc6ebd4fde2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:35.576613 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-e85fb4cd-d4f8-4c47-8d83-ddc6ebd4fde2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e85fb4cd-d4f8-4c47-8d83-ddc6ebd4fde2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 HTTP/1.1 Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:51:35.584103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:51:35.585890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'b503f6b2-890d-41b0-9323-5af163d8a016'} Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:51:35.586783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:51:35.588211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:35.589444 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e85fb4cd-d4f8-4c47-8d83-ddc6ebd4fde2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:51:35.589444 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e85fb4cd-d4f8-4c47-8d83-ddc6ebd4fde2 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 404 len: 111 microversion: 2.1 time: 0.034240 Jul 18 08:51:35.589444 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 329/662] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:35 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:51:35.589733 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2e3a0f91-cff4-4e79-9b68-c31854572a5e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '.version_select at 0x7fafb7084ca0>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:35.664251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2e3a0f91-cff4-4e79-9b68-c31854572a5e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894252202" status: 202 len: 0 microversion: 2.1 time: 0.078279 Jul 18 08:51:35.665387 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 334/663] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 08:51:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1894252202 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 08:51:36.538276 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b6909d4d-b809-4a24-b5e9-5256ea78b9d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: .version_select at 0x7fafb72139d0>, body: {"keypair": {"name": "tempest-keypair-2031141248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSyux9umYtstz2pOFGE4DpedtWHDtUjKr1L2STln88498z3sgu58HEhQirNj5Lb5yZwNCI/x3179+wZbnOZM6x+o4dSGByN/gn9yPay8ajfuioRsHT+BmcsBJgEFMHXeA=="}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:36.543042 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:36.557810 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-b6909d4d-b809-4a24-b5e9-5256ea78b9d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:51:36.571694 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-b6909d4d-b809-4a24-b5e9-5256ea78b9d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for user 4e6b788e0819483580c09902a341ea6d and project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:51:36.686329 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b6909d4d-b809-4a24-b5e9-5256ea78b9d8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152771 Jul 18 08:51:36.686873 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 330/664] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 08:51:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:38.349442 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-19f87a08-89be-4af2-8e7a-935d216dea38 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:38.349991 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-19f87a08-89be-4af2-8e7a-935d216dea38 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:38.359378 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-19f87a08-89be-4af2-8e7a-935d216dea38 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:38.359867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-19f87a08-89be-4af2-8e7a-935d216dea38 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:38.360647 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-19f87a08-89be-4af2-8e7a-935d216dea38 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:38.362015 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-19f87a08-89be-4af2-8e7a-935d216dea38 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:38.389490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-19f87a08-89be-4af2-8e7a-935d216dea38 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:51:38.667984 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-19f87a08-89be-4af2-8e7a-935d216dea38 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "DELETE /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 204 len: 0 microversion: 2.1 time: 0.322708 Jul 18 08:51:38.668632 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 335/665] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:51:38 2022] DELETE /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:51:38.678059 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e7fd9ce1-5493-4829-8620-1d59733fa54b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:38.678666 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e7fd9ce1-5493-4829-8620-1d59733fa54b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:38.688343 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e7fd9ce1-5493-4829-8620-1d59733fa54b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:38.688785 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e7fd9ce1-5493-4829-8620-1d59733fa54b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:38.689885 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e7fd9ce1-5493-4829-8620-1d59733fa54b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:38.691287 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e7fd9ce1-5493-4829-8620-1d59733fa54b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:38.870578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e7fd9ce1-5493-4829-8620-1d59733fa54b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:38.878136 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e7fd9ce1-5493-4829-8620-1d59733fa54b tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1506 microversion: 2.1 time: 0.204983 Jul 18 08:51:38.878705 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 331/666] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:38 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:38.931700 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-882056446", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91d2b33d-7b11-4b88-9cd3-44537bfe048d"}], "security_groups": [{"name": "tempest-securitygroup--475778329"}], "key_name": "tempest-keypair-2031141248", "user_data": "}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:39.039995 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.network.neutron [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] validate_networks() for [('91d2b33d-7b11-4b88-9cd3-44537bfe048d', None, None, None, None, None)] {{(pid=124894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:51:39.464614 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Flavor limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:51:39.465289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Image limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:51:39.465510 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Flavor pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:51:39.465924 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Image pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:51:39.466360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:51:39.475639 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:39.476122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:39.476925 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:39.477363 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:39.496667 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:51:39.500681 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Getting quotas for user 4e6b788e0819483580c09902a341ea6d and project ab95af0a9cb74221a15ac73cbb8ca0ff. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:51:39.512619 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Going to run 1 instances... {{(pid=124894) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:51:39.515006 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:51:39.654062 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-66f47eb9-8d8b-4739-af7b-bfded48a8ede tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.726921 Jul 18 08:51:39.654716 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 336/667] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:51:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:51:39.666554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6b2e40bf-6586-44fb-b1b7-e4a66d6a4f2e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:39.667367 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-6b2e40bf-6586-44fb-b1b7-e4a66d6a4f2e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:39.731017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6b2e40bf-6586-44fb-b1b7-e4a66d6a4f2e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:39.737944 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-6b2e40bf-6586-44fb-b1b7-e4a66d6a4f2e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1241 microversion: 2.1 time: 0.075324 Jul 18 08:51:39.738506 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 332/668] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:39 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:39.896748 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-cce3569f-7453-4550-a1b6-1ee552863ec8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:39.897462 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-cce3569f-7453-4550-a1b6-1ee552863ec8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:39.905801 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cce3569f-7453-4550-a1b6-1ee552863ec8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:39.906251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cce3569f-7453-4550-a1b6-1ee552863ec8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:39.907012 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cce3569f-7453-4550-a1b6-1ee552863ec8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:39.907452 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cce3569f-7453-4550-a1b6-1ee552863ec8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:40.051394 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-cce3569f-7453-4550-a1b6-1ee552863ec8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:40.059064 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-cce3569f-7453-4550-a1b6-1ee552863ec8 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1506 microversion: 2.1 time: 0.168561 Jul 18 08:51:40.059646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 337/669] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:39 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:40.756166 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-45ee07e0-61e2-471d-8462-a23c04124d76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:40.756782 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-45ee07e0-61e2-471d-8462-a23c04124d76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:40.765558 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-45ee07e0-61e2-471d-8462-a23c04124d76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:40.766007 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-45ee07e0-61e2-471d-8462-a23c04124d76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:40.766763 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-45ee07e0-61e2-471d-8462-a23c04124d76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:40.767195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-45ee07e0-61e2-471d-8462-a23c04124d76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:40.833317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-45ee07e0-61e2-471d-8462-a23c04124d76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:40.840910 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-45ee07e0-61e2-471d-8462-a23c04124d76 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1245 microversion: 2.1 time: 0.089442 Jul 18 08:51:40.841483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 333/670] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:40 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:41.076743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d1af6e37-9657-4d6a-8521-78be70a86149 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:41.077581 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d1af6e37-9657-4d6a-8521-78be70a86149 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:41.083620 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1af6e37-9657-4d6a-8521-78be70a86149 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:41.084104 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1af6e37-9657-4d6a-8521-78be70a86149 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:41.090315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1af6e37-9657-4d6a-8521-78be70a86149 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:41.090315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1af6e37-9657-4d6a-8521-78be70a86149 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:41.218843 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d1af6e37-9657-4d6a-8521-78be70a86149 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:41.226842 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d1af6e37-9657-4d6a-8521-78be70a86149 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1506 microversion: 2.1 time: 0.154594 Jul 18 08:51:41.227433 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 338/671] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:41 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:41.795539 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-dc9f972f-420e-42f6-a89f-b1b7d6d2a121 req-4ff2a7dc-4452-4dbd-9a7b-44e6a228ce5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84de371b-4af7-43af-be6d-ed94e96dcd91", "name": "network-vif-deleted", "tag": "88a52aef-93c6-4a56-800d-706ae67440c0"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:41.805200 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-dc9f972f-420e-42f6-a89f-b1b7d6d2a121 req-4ff2a7dc-4452-4dbd-9a7b-44e6a228ce5a service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:41.805642 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-dc9f972f-420e-42f6-a89f-b1b7d6d2a121 req-4ff2a7dc-4452-4dbd-9a7b-44e6a228ce5a service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:41.817273 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-dc9f972f-420e-42f6-a89f-b1b7d6d2a121 req-4ff2a7dc-4452-4dbd-9a7b-44e6a228ce5a service nova] Creating event network-vif-deleted:88a52aef-93c6-4a56-800d-706ae67440c0 for instance 84de371b-4af7-43af-be6d-ed94e96dcd91 on hv-cinder-85014 Jul 18 08:51:41.822896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-dc9f972f-420e-42f6-a89f-b1b7d6d2a121 req-4ff2a7dc-4452-4dbd-9a7b-44e6a228ce5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031084 Jul 18 08:51:41.824092 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 334/672] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:41.859231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ce0060b5-7cab-40c7-99dc-80c5bdc016f0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:41.860409 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ce0060b5-7cab-40c7-99dc-80c5bdc016f0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:41.866911 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce0060b5-7cab-40c7-99dc-80c5bdc016f0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:41.867359 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce0060b5-7cab-40c7-99dc-80c5bdc016f0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:41.868167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce0060b5-7cab-40c7-99dc-80c5bdc016f0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:41.868595 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce0060b5-7cab-40c7-99dc-80c5bdc016f0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:41.939533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ce0060b5-7cab-40c7-99dc-80c5bdc016f0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:41.947564 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ce0060b5-7cab-40c7-99dc-80c5bdc016f0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1293 microversion: 2.1 time: 0.093598 Jul 18 08:51:41.948169 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 339/673] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:41 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:42.249906 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-27e41969-391c-4b2c-895a-3df44336afa2 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:42.251475 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-27e41969-391c-4b2c-895a-3df44336afa2 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:42.264424 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-27e41969-391c-4b2c-895a-3df44336afa2 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:42.265202 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-27e41969-391c-4b2c-895a-3df44336afa2 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:42.266735 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-27e41969-391c-4b2c-895a-3df44336afa2 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:42.267523 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-27e41969-391c-4b2c-895a-3df44336afa2 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:42.307545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-27e41969-391c-4b2c-895a-3df44336afa2 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:42.308025 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-27e41969-391c-4b2c-895a-3df44336afa2 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:42.308687 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-27e41969-391c-4b2c-895a-3df44336afa2 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lazy-loading 'fault' on Instance uuid 84de371b-4af7-43af-be6d-ed94e96dcd91 {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:51:42.354636 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-27e41969-391c-4b2c-895a-3df44336afa2 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:42.364270 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-27e41969-391c-4b2c-895a-3df44336afa2 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 200 len: 1311 microversion: 2.1 time: 0.122327 Jul 18 08:51:42.374112 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 335/674] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:42 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 1311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:42.971061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e4cdf6cd-2773-4156-8794-b18066bebac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:42.971788 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e4cdf6cd-2773-4156-8794-b18066bebac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:42.978703 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4cdf6cd-2773-4156-8794-b18066bebac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:42.979152 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4cdf6cd-2773-4156-8794-b18066bebac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:42.979962 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4cdf6cd-2773-4156-8794-b18066bebac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:42.980420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4cdf6cd-2773-4156-8794-b18066bebac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:43.072743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e4cdf6cd-2773-4156-8794-b18066bebac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:43.083264 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e4cdf6cd-2773-4156-8794-b18066bebac0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1299 microversion: 2.1 time: 0.116449 Jul 18 08:51:43.093124 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 340/675] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:42 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:43.386310 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4244b621-5f65-42ad-891f-b34a0ae6df98 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:43.387741 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-4244b621-5f65-42ad-891f-b34a0ae6df98 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 84de371b-4af7-43af-be6d-ed94e96dcd91] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:43.396490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4244b621-5f65-42ad-891f-b34a0ae6df98 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:43.397277 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4244b621-5f65-42ad-891f-b34a0ae6df98 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:43.399526 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4244b621-5f65-42ad-891f-b34a0ae6df98 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:43.400339 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4244b621-5f65-42ad-891f-b34a0ae6df98 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:43.418609 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-4244b621-5f65-42ad-891f-b34a0ae6df98 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] HTTP exception thrown: Instance 84de371b-4af7-43af-be6d-ed94e96dcd91 could not be found. Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4244b621-5f65-42ad-891f-b34a0ae6df98 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Request method failure captured: Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 HTTP/1.1 Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3dPNM7loaJvWicYRxKNa0h2dELfsNCPBqGOVbM4VjyGgJ8YI3dpOKCRIG5ADhj0bk2Bwryh-K90h_Jd2S_dfzg6t89cOJ8oymbW0JrDzOPUwdA8pKjvNq7gMlvwLqdNYbV-dQFiRSW1qJ2dH3Y8KvvCxUHLV49BOovZ4stJNLcNu8 Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: c2f44b51cc624637bccd9ed1d3b1a769 Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:51:43.420453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2f44b51cc624637bccd9ed1d3b1a769", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: c2f44b51cc624637bccd9ed1d3b1a769 Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-ServerRescueNegativeTestJSON-220645641-project Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 56b3d8d145d94b358c86345eb5c3b306 Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-ServerRescueNegativeTestJSON-220645641-project Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance 84de371b-4af7-43af-be6d-ed94e96dcd91 could not be found. Jul 18 08:51:43.422023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': '84de371b-4af7-43af-be6d-ed94e96dcd91'} Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84de371b-4af7-43af-be6d-ed94e96dcd91 could not be found. Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:51:43.422881 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84de371b-4af7-43af-be6d-ed94e96dcd91 could not be found. Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84de371b-4af7-43af-be6d-ed94e96dcd91 could not be found. Jul 18 08:51:43.431171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:51:43.432538 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4244b621-5f65-42ad-891f-b34a0ae6df98 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Returning 404 to user: Instance 84de371b-4af7-43af-be6d-ed94e96dcd91 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:51:43.432538 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-4244b621-5f65-42ad-891f-b34a0ae6df98 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91" status: 404 len: 111 microversion: 2.1 time: 0.039895 Jul 18 08:51:43.432538 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 336/676] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:43 2022] GET /compute/v2.1/servers/84de371b-4af7-43af-be6d-ed94e96dcd91 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:51:43.432790 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-79a1026b-4aa9-4634-ba21-543bbf6f2095 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:43.433289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-79a1026b-4aa9-4634-ba21-543bbf6f2095 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:43.439731 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-79a1026b-4aa9-4634-ba21-543bbf6f2095 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:43.440762 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-79a1026b-4aa9-4634-ba21-543bbf6f2095 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:43.441689 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-79a1026b-4aa9-4634-ba21-543bbf6f2095 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:43.442506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-79a1026b-4aa9-4634-ba21-543bbf6f2095 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:43.472468 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-79a1026b-4aa9-4634-ba21-543bbf6f2095 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:51:43.867997 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-79a1026b-4aa9-4634-ba21-543bbf6f2095 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "DELETE /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 204 len: 0 microversion: 2.1 time: 0.439226 Jul 18 08:51:43.868787 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 341/677] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:51:43 2022] DELETE /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:51:43.877516 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-86e1e42d-eb4a-4625-b6f3-a0ecb2583456 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:43.878134 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-86e1e42d-eb4a-4625-b6f3-a0ecb2583456 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:43.885146 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-86e1e42d-eb4a-4625-b6f3-a0ecb2583456 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:43.885591 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-86e1e42d-eb4a-4625-b6f3-a0ecb2583456 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:43.886565 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-86e1e42d-eb4a-4625-b6f3-a0ecb2583456 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:43.886805 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-86e1e42d-eb4a-4625-b6f3-a0ecb2583456 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:44.042116 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-86e1e42d-eb4a-4625-b6f3-a0ecb2583456 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:44.051275 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-86e1e42d-eb4a-4625-b6f3-a0ecb2583456 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.178124 Jul 18 08:51:44.057260 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 337/678] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:43 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:44.101710 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6b1897db-90b7-4d31-93d0-9b88576c65da tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:44.102413 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6b1897db-90b7-4d31-93d0-9b88576c65da tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:44.109033 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6b1897db-90b7-4d31-93d0-9b88576c65da tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:44.109636 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6b1897db-90b7-4d31-93d0-9b88576c65da tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:44.110506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6b1897db-90b7-4d31-93d0-9b88576c65da tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:44.111002 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6b1897db-90b7-4d31-93d0-9b88576c65da tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:44.262811 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6b1897db-90b7-4d31-93d0-9b88576c65da tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:44.271338 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6b1897db-90b7-4d31-93d0-9b88576c65da tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1366 microversion: 2.1 time: 0.173978 Jul 18 08:51:44.271973 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 342/679] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:44 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:44.712839 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-a41935bc-3ecd-4f50-ba3d-069cd96dbe43 req-85c99d48-7280-47e4-b70f-383a31ad78b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab98b057-4071-4710-8fd9-d6d98cc8f159", "tag": "f3097c6f-2822-4140-90fd-598d399f4804"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:44.721614 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-a41935bc-3ecd-4f50-ba3d-069cd96dbe43 req-85c99d48-7280-47e4-b70f-383a31ad78b4 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:44.722049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-a41935bc-3ecd-4f50-ba3d-069cd96dbe43 req-85c99d48-7280-47e4-b70f-383a31ad78b4 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:44.733213 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-a41935bc-3ecd-4f50-ba3d-069cd96dbe43 req-85c99d48-7280-47e4-b70f-383a31ad78b4 service nova] Creating event network-changed:f3097c6f-2822-4140-90fd-598d399f4804 for instance ab98b057-4071-4710-8fd9-d6d98cc8f159 on hv-cinder-85014 Jul 18 08:51:44.738698 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-a41935bc-3ecd-4f50-ba3d-069cd96dbe43 req-85c99d48-7280-47e4-b70f-383a31ad78b4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097422 Jul 18 08:51:44.739299 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 338/680] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:45.068072 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f3b61807-cc9f-4dde-a2b9-e2161b34e3eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:45.068676 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f3b61807-cc9f-4dde-a2b9-e2161b34e3eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:45.074737 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f3b61807-cc9f-4dde-a2b9-e2161b34e3eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:45.075182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f3b61807-cc9f-4dde-a2b9-e2161b34e3eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:45.075965 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f3b61807-cc9f-4dde-a2b9-e2161b34e3eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:45.076401 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f3b61807-cc9f-4dde-a2b9-e2161b34e3eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:45.079235 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:45.209363 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f3b61807-cc9f-4dde-a2b9-e2161b34e3eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:45.217195 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f3b61807-cc9f-4dde-a2b9-e2161b34e3eb tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.153181 Jul 18 08:51:45.217763 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 343/681] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:45 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:45.291197 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f4899716-a01c-4857-837f-176f5e89cbc3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:45.291941 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f4899716-a01c-4857-837f-176f5e89cbc3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:45.298150 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f4899716-a01c-4857-837f-176f5e89cbc3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:45.298596 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f4899716-a01c-4857-837f-176f5e89cbc3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:45.299488 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f4899716-a01c-4857-837f-176f5e89cbc3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:45.299957 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f4899716-a01c-4857-837f-176f5e89cbc3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:45.430212 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f4899716-a01c-4857-837f-176f5e89cbc3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:45.437580 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f4899716-a01c-4857-837f-176f5e89cbc3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1366 microversion: 2.1 time: 0.150679 Jul 18 08:51:45.438143 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 339/682] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:45 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:46.233559 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-30c4d6f2-9382-4da4-84f5-b20c5984d5d3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:46.234336 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-30c4d6f2-9382-4da4-84f5-b20c5984d5d3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:46.241825 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-30c4d6f2-9382-4da4-84f5-b20c5984d5d3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:46.242304 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-30c4d6f2-9382-4da4-84f5-b20c5984d5d3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:46.243098 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-30c4d6f2-9382-4da4-84f5-b20c5984d5d3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:46.243512 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-30c4d6f2-9382-4da4-84f5-b20c5984d5d3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:46.376047 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-30c4d6f2-9382-4da4-84f5-b20c5984d5d3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:46.385547 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-30c4d6f2-9382-4da4-84f5-b20c5984d5d3 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.155753 Jul 18 08:51:46.386204 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 344/683] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:46 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:46.454579 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-80fb78c2-94a7-4ea3-aa6c-0d4fce70e556 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:46.455752 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-80fb78c2-94a7-4ea3-aa6c-0d4fce70e556 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:46.462305 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80fb78c2-94a7-4ea3-aa6c-0d4fce70e556 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:46.462785 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80fb78c2-94a7-4ea3-aa6c-0d4fce70e556 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:46.463592 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80fb78c2-94a7-4ea3-aa6c-0d4fce70e556 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:46.464054 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80fb78c2-94a7-4ea3-aa6c-0d4fce70e556 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:46.598021 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-80fb78c2-94a7-4ea3-aa6c-0d4fce70e556 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:46.602583 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:46.606935 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-80fb78c2-94a7-4ea3-aa6c-0d4fce70e556 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1366 microversion: 2.1 time: 0.156392 Jul 18 08:51:46.607530 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 340/684] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:46 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:47.402909 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b6de5e80-2599-4424-9670-da655c079d8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:47.403477 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b6de5e80-2599-4424-9670-da655c079d8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:47.411555 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b6de5e80-2599-4424-9670-da655c079d8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:47.412016 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b6de5e80-2599-4424-9670-da655c079d8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:47.412992 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b6de5e80-2599-4424-9670-da655c079d8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:47.413436 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b6de5e80-2599-4424-9670-da655c079d8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:47.624761 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-43b8e91f-b859-42a5-8396-6d86601e2b6e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:47.625411 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-43b8e91f-b859-42a5-8396-6d86601e2b6e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:47.633225 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-43b8e91f-b859-42a5-8396-6d86601e2b6e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:47.633668 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-43b8e91f-b859-42a5-8396-6d86601e2b6e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:47.634438 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-43b8e91f-b859-42a5-8396-6d86601e2b6e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:47.634868 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-43b8e91f-b859-42a5-8396-6d86601e2b6e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:47.642803 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b6de5e80-2599-4424-9670-da655c079d8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:47.651707 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b6de5e80-2599-4424-9670-da655c079d8a tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1520 microversion: 2.1 time: 0.252663 Jul 18 08:51:47.663300 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 345/685] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:47 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:48.043697 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-6f61737f-8d04-400b-b4e3-587cb015379c req-19fd97a0-5d49-49d3-98b5-fff728916fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75cd9ec0-94a9-4043-983e-d876084556ad", "name": "network-vif-deleted", "tag": "78901683-090c-493b-919a-d66d30e8239b"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:48.052774 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-6f61737f-8d04-400b-b4e3-587cb015379c req-19fd97a0-5d49-49d3-98b5-fff728916fe5 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:48.053240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-6f61737f-8d04-400b-b4e3-587cb015379c req-19fd97a0-5d49-49d3-98b5-fff728916fe5 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:48.064258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-6f61737f-8d04-400b-b4e3-587cb015379c req-19fd97a0-5d49-49d3-98b5-fff728916fe5 service nova] Creating event network-vif-deleted:78901683-090c-493b-919a-d66d30e8239b for instance 75cd9ec0-94a9-4043-983e-d876084556ad on hv-cinder-85014 Jul 18 08:51:48.069982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-6f61737f-8d04-400b-b4e3-587cb015379c req-19fd97a0-5d49-49d3-98b5-fff728916fe5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029941 Jul 18 08:51:48.070584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 346/686] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:48.124590 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-43b8e91f-b859-42a5-8396-6d86601e2b6e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:48.137079 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-43b8e91f-b859-42a5-8396-6d86601e2b6e tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1366 microversion: 2.1 time: 0.516597 Jul 18 08:51:48.147222 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 341/687] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:47 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:51:48.670875 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f82a9622-8d00-41fa-8047-0bb202ccd63e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:48.671459 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f82a9622-8d00-41fa-8047-0bb202ccd63e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:48.678323 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f82a9622-8d00-41fa-8047-0bb202ccd63e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:48.678768 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f82a9622-8d00-41fa-8047-0bb202ccd63e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:48.679543 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f82a9622-8d00-41fa-8047-0bb202ccd63e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:48.680009 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f82a9622-8d00-41fa-8047-0bb202ccd63e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:48.707550 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:48.712423 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f82a9622-8d00-41fa-8047-0bb202ccd63e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:48.712871 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f82a9622-8d00-41fa-8047-0bb202ccd63e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:48.713315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-f82a9622-8d00-41fa-8047-0bb202ccd63e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lazy-loading 'fault' on Instance uuid 75cd9ec0-94a9-4043-983e-d876084556ad {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:51:48.756302 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f82a9622-8d00-41fa-8047-0bb202ccd63e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:48.764256 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f82a9622-8d00-41fa-8047-0bb202ccd63e tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1311 microversion: 2.1 time: 0.098258 Jul 18 08:51:48.764831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 347/688] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:48 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:49.154414 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f855b229-ccfe-4f0b-83a1-1886d812e0e0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:49.155005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f855b229-ccfe-4f0b-83a1-1886d812e0e0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:49.161690 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f855b229-ccfe-4f0b-83a1-1886d812e0e0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:49.162148 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f855b229-ccfe-4f0b-83a1-1886d812e0e0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:49.162914 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f855b229-ccfe-4f0b-83a1-1886d812e0e0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:49.163351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f855b229-ccfe-4f0b-83a1-1886d812e0e0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:49.296080 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f855b229-ccfe-4f0b-83a1-1886d812e0e0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:49.304315 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f855b229-ccfe-4f0b-83a1-1886d812e0e0 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1366 microversion: 2.1 time: 0.153696 Jul 18 08:51:49.304918 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 342/689] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:49 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:49.781621 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-84ed93ec-48d9-4611-aa92-b431ef8474a4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:49.782187 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-84ed93ec-48d9-4611-aa92-b431ef8474a4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:49.784353 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:49.785128 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=6 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:49.790954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-84ed93ec-48d9-4611-aa92-b431ef8474a4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:49.791402 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-84ed93ec-48d9-4611-aa92-b431ef8474a4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:49.795031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-84ed93ec-48d9-4611-aa92-b431ef8474a4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:49.795031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-84ed93ec-48d9-4611-aa92-b431ef8474a4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:49.826821 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-84ed93ec-48d9-4611-aa92-b431ef8474a4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:49.827525 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-84ed93ec-48d9-4611-aa92-b431ef8474a4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:49.828006 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-84ed93ec-48d9-4611-aa92-b431ef8474a4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lazy-loading 'fault' on Instance uuid 75cd9ec0-94a9-4043-983e-d876084556ad {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:51:49.872046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-84ed93ec-48d9-4611-aa92-b431ef8474a4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b3d8d145d94b358c86345eb5c3b306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2f44b51cc624637bccd9ed1d3b1a769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:49.880133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-84ed93ec-48d9-4611-aa92-b431ef8474a4 tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 200 len: 1311 microversion: 2.1 time: 0.102435 Jul 18 08:51:49.880745 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 348/690] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:49 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:50.321226 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2c5c3d80-4702-48e7-af6d-63c45834ab86 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:50.321817 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2c5c3d80-4702-48e7-af6d-63c45834ab86 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:50.323747 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=6 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:51:50.329371 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2c5c3d80-4702-48e7-af6d-63c45834ab86 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:50.330359 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2c5c3d80-4702-48e7-af6d-63c45834ab86 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:50.337674 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2c5c3d80-4702-48e7-af6d-63c45834ab86 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:50.337674 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2c5c3d80-4702-48e7-af6d-63c45834ab86 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:50.473424 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2c5c3d80-4702-48e7-af6d-63c45834ab86 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:50.481347 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2c5c3d80-4702-48e7-af6d-63c45834ab86 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1366 microversion: 2.1 time: 0.163892 Jul 18 08:51:50.482037 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 343/691] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:50 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:50.900293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e8b7a6f0-4002-439c-a564-8d1ee32763ee tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:50.900905 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e8b7a6f0-4002-439c-a564-8d1ee32763ee tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] [instance: 75cd9ec0-94a9-4043-983e-d876084556ad] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:50.908217 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e8b7a6f0-4002-439c-a564-8d1ee32763ee tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:50.909342 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e8b7a6f0-4002-439c-a564-8d1ee32763ee tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:50.910104 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e8b7a6f0-4002-439c-a564-8d1ee32763ee tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:50.910542 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e8b7a6f0-4002-439c-a564-8d1ee32763ee tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:50.925119 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-e8b7a6f0-4002-439c-a564-8d1ee32763ee tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] HTTP exception thrown: Instance 75cd9ec0-94a9-4043-983e-d876084556ad could not be found. Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e8b7a6f0-4002-439c-a564-8d1ee32763ee tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Request method failure captured: Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad HTTP/1.1 Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3dPNM7loaJvWicYRxKNa0h2dELfsNCPBqGOVbM4VjyGgJ8YI3dpOKCRIG5ADhj0bk2Bwryh-K90h_Jd2S_dfzg6t89cOJ8oymbW0JrDzOPUwdA8pKjvNq7gMlvwLqdNYbV-dQFiRSW1qJ2dH3Y8KvvCxUHLV49BOovZ4stJNLcNu8 Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: c2f44b51cc624637bccd9ed1d3b1a769 Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:51:50.926848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c2f44b51cc624637bccd9ed1d3b1a769"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c2f44b51cc624637bccd9ed1d3b1a769", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: c2f44b51cc624637bccd9ed1d3b1a769 Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-220645641 Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-ServerRescueNegativeTestJSON-220645641-project Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 56b3d8d145d94b358c86345eb5c3b306 Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-ServerRescueNegativeTestJSON-220645641-project Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 75cd9ec0-94a9-4043-983e-d876084556ad could not be found. Jul 18 08:51:50.928386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '75cd9ec0-94a9-4043-983e-d876084556ad'} Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75cd9ec0-94a9-4043-983e-d876084556ad could not be found. Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:51:50.929207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75cd9ec0-94a9-4043-983e-d876084556ad could not be found. Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75cd9ec0-94a9-4043-983e-d876084556ad could not be found. Jul 18 08:51:50.930389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:51:50.931449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e8b7a6f0-4002-439c-a564-8d1ee32763ee tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] Returning 404 to user: Instance 75cd9ec0-94a9-4043-983e-d876084556ad could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:51:50.931449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e8b7a6f0-4002-439c-a564-8d1ee32763ee tempest-ServerRescueNegativeTestJSON-220645641 tempest-ServerRescueNegativeTestJSON-220645641-project] 10.222.0.57 "GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad" status: 404 len: 111 microversion: 2.1 time: 0.035333 Jul 18 08:51:50.931449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 349/692] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:50 2022] GET /compute/v2.1/servers/75cd9ec0-94a9-4043-983e-d876084556ad => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 08:51:51.498424 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5694d552-709e-4789-b8c6-91e9c82a86fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:51.499088 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5694d552-709e-4789-b8c6-91e9c82a86fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:51.506001 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5694d552-709e-4789-b8c6-91e9c82a86fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:51.506447 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5694d552-709e-4789-b8c6-91e9c82a86fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:51.507216 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5694d552-709e-4789-b8c6-91e9c82a86fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:51.507643 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5694d552-709e-4789-b8c6-91e9c82a86fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:51.643788 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5694d552-709e-4789-b8c6-91e9c82a86fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:51.651178 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5694d552-709e-4789-b8c6-91e9c82a86fd tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1366 microversion: 2.1 time: 0.156675 Jul 18 08:51:51.652018 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 344/693] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:51 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:52.637656 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-0f2c8ed5-df99-45b0-9610-635facdd93fd req-e38ff7d7-f4ef-45ab-b5e3-5ac35b5b8c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab98b057-4071-4710-8fd9-d6d98cc8f159", "name": "network-vif-plugged", "status": "completed", "tag": "f3097c6f-2822-4140-90fd-598d399f4804"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:52.648386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-0f2c8ed5-df99-45b0-9610-635facdd93fd req-e38ff7d7-f4ef-45ab-b5e3-5ac35b5b8c90 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:52.648836 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-0f2c8ed5-df99-45b0-9610-635facdd93fd req-e38ff7d7-f4ef-45ab-b5e3-5ac35b5b8c90 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:52.664681 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-0f2c8ed5-df99-45b0-9610-635facdd93fd req-e38ff7d7-f4ef-45ab-b5e3-5ac35b5b8c90 service nova] Creating event network-vif-plugged:f3097c6f-2822-4140-90fd-598d399f4804 for instance ab98b057-4071-4710-8fd9-d6d98cc8f159 on hv-cinder-85014 Jul 18 08:51:52.668463 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2e30a0aa-3865-46fa-b48e-4c53026909f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:52.669299 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2e30a0aa-3865-46fa-b48e-4c53026909f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:52.670516 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-0f2c8ed5-df99-45b0-9610-635facdd93fd req-e38ff7d7-f4ef-45ab-b5e3-5ac35b5b8c90 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042079 Jul 18 08:51:52.671103 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 350/694] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:52.686473 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2e30a0aa-3865-46fa-b48e-4c53026909f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:52.686932 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2e30a0aa-3865-46fa-b48e-4c53026909f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:52.687773 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2e30a0aa-3865-46fa-b48e-4c53026909f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:52.688223 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2e30a0aa-3865-46fa-b48e-4c53026909f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:52.860971 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2e30a0aa-3865-46fa-b48e-4c53026909f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:52.869504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2e30a0aa-3865-46fa-b48e-4c53026909f4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1366 microversion: 2.1 time: 0.204692 Jul 18 08:51:52.872454 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 345/695] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:52 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:53.887459 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-136545aa-d5c7-4b9d-b440-6cd706bc23b3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:53.888098 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-136545aa-d5c7-4b9d-b440-6cd706bc23b3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:53.895137 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-136545aa-d5c7-4b9d-b440-6cd706bc23b3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:53.895587 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-136545aa-d5c7-4b9d-b440-6cd706bc23b3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:53.896382 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-136545aa-d5c7-4b9d-b440-6cd706bc23b3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:53.896824 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-136545aa-d5c7-4b9d-b440-6cd706bc23b3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:54.047305 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-136545aa-d5c7-4b9d-b440-6cd706bc23b3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:54.057940 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-136545aa-d5c7-4b9d-b440-6cd706bc23b3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1366 microversion: 2.1 time: 0.175137 Jul 18 08:51:54.061133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 351/696] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:53 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:54.252405 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-71873a0b-3262-44f9-a6a3-8611f75a6830 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:54.252916 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-71873a0b-3262-44f9-a6a3-8611f75a6830 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:54.259282 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-71873a0b-3262-44f9-a6a3-8611f75a6830 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:54.268198 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-71873a0b-3262-44f9-a6a3-8611f75a6830 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:54.268198 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-71873a0b-3262-44f9-a6a3-8611f75a6830 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:54.268198 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-71873a0b-3262-44f9-a6a3-8611f75a6830 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:54.285186 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-71873a0b-3262-44f9-a6a3-8611f75a6830 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/ips" status: 200 len: 152 microversion: 2.20 time: 0.089488 Jul 18 08:51:54.291258 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 346/697] 10.222.0.57 () {60 vars in 1288 bytes} [Mon Jul 18 08:51:54 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/ips => generated 152 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 08:51:55.074568 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1c37aedb-c580-474b-ba11-82500916ae1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:55.075186 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1c37aedb-c580-474b-ba11-82500916ae1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:55.083077 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c37aedb-c580-474b-ba11-82500916ae1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:55.083535 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c37aedb-c580-474b-ba11-82500916ae1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:55.086196 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c37aedb-c580-474b-ba11-82500916ae1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:55.086196 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1c37aedb-c580-474b-ba11-82500916ae1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:55.233090 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1c37aedb-c580-474b-ba11-82500916ae1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:55.241948 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1c37aedb-c580-474b-ba11-82500916ae1a tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1556 microversion: 2.1 time: 0.171338 Jul 18 08:51:55.242450 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 352/698] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:51:55 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:51:55.260196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e383f85e-a9fc-49dd-aeb0-1f0aaf8fc7e8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:55.260644 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e383f85e-a9fc-49dd-aeb0-1f0aaf8fc7e8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:55.267157 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e383f85e-a9fc-49dd-aeb0-1f0aaf8fc7e8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:55.267600 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e383f85e-a9fc-49dd-aeb0-1f0aaf8fc7e8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:55.268506 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e383f85e-a9fc-49dd-aeb0-1f0aaf8fc7e8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:55.268939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e383f85e-a9fc-49dd-aeb0-1f0aaf8fc7e8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:55.349145 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e383f85e-a9fc-49dd-aeb0-1f0aaf8fc7e8 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093112 Jul 18 08:51:55.349860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 347/699] 10.222.0.57 () {58 vars in 1274 bytes} [Mon Jul 18 08:51:55 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:56.587528 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0f7e8bd8-20d2-4883-a6d3-649e36ad5149 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:56.588934 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0f7e8bd8-20d2-4883-a6d3-649e36ad5149 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:56.598339 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0f7e8bd8-20d2-4883-a6d3-649e36ad5149 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:56.598785 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0f7e8bd8-20d2-4883-a6d3-649e36ad5149 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:56.599913 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0f7e8bd8-20d2-4883-a6d3-649e36ad5149 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:56.600619 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0f7e8bd8-20d2-4883-a6d3-649e36ad5149 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:56.634053 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-0f7e8bd8-20d2-4883-a6d3-649e36ad5149 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lazy-loading 'flavor' on Instance uuid 18040578-a916-4929-ae00-067b0441f8e7 {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:51:56.664448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-748581d8-da42-45c7-89d7-d9b51bbbe4a9 req-eec079d7-2ee5-405c-b542-aaae25952ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab98b057-4071-4710-8fd9-d6d98cc8f159", "tag": "f3097c6f-2822-4140-90fd-598d399f4804"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:51:56.673046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-748581d8-da42-45c7-89d7-d9b51bbbe4a9 req-eec079d7-2ee5-405c-b542-aaae25952ae2 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:56.673593 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-748581d8-da42-45c7-89d7-d9b51bbbe4a9 req-eec079d7-2ee5-405c-b542-aaae25952ae2 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:56.685966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-748581d8-da42-45c7-89d7-d9b51bbbe4a9 req-eec079d7-2ee5-405c-b542-aaae25952ae2 service nova] Creating event network-changed:f3097c6f-2822-4140-90fd-598d399f4804 for instance ab98b057-4071-4710-8fd9-d6d98cc8f159 on hv-cinder-85014 Jul 18 08:51:56.691129 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-748581d8-da42-45c7-89d7-d9b51bbbe4a9 req-eec079d7-2ee5-405c-b542-aaae25952ae2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252280 Jul 18 08:51:56.692243 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 353/700] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:57.303146 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0f7e8bd8-20d2-4883-a6d3-649e36ad5149 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "POST /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/action" status: 202 len: 0 microversion: 2.20 time: 0.719638 Jul 18 08:51:57.304306 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 348/701] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 08:51:56 2022] POST /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/action => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 08:51:57.317407 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5628ca41-6bd6-430d-ad18-b706c1a3191f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:57.318879 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5628ca41-6bd6-430d-ad18-b706c1a3191f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:57.329086 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5628ca41-6bd6-430d-ad18-b706c1a3191f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:57.334280 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5628ca41-6bd6-430d-ad18-b706c1a3191f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:57.334280 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5628ca41-6bd6-430d-ad18-b706c1a3191f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:57.334280 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5628ca41-6bd6-430d-ad18-b706c1a3191f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:57.501086 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5628ca41-6bd6-430d-ad18-b706c1a3191f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:57.511539 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5628ca41-6bd6-430d-ad18-b706c1a3191f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:57.514787 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5628ca41-6bd6-430d-ad18-b706c1a3191f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:57.516042 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5628ca41-6bd6-430d-ad18-b706c1a3191f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.207397 Jul 18 08:51:57.516612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 354/702] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:51:57 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:51:58.537944 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-11a664f7-c2df-4caf-a908-3e8b15acf266 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:58.538701 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-11a664f7-c2df-4caf-a908-3e8b15acf266 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:58.546121 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-11a664f7-c2df-4caf-a908-3e8b15acf266 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:58.546571 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-11a664f7-c2df-4caf-a908-3e8b15acf266 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:58.547423 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-11a664f7-c2df-4caf-a908-3e8b15acf266 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:58.547896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-11a664f7-c2df-4caf-a908-3e8b15acf266 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:58.714288 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-11a664f7-c2df-4caf-a908-3e8b15acf266 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:58.722692 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-11a664f7-c2df-4caf-a908-3e8b15acf266 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:58.724227 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-11a664f7-c2df-4caf-a908-3e8b15acf266 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:58.725512 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-11a664f7-c2df-4caf-a908-3e8b15acf266 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.192925 Jul 18 08:51:58.726076 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 349/703] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:51:58 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:51:58.934433 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-99048ea8-3752-46f3-8d36-9226a1982f68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:58.934966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-99048ea8-3752-46f3-8d36-9226a1982f68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:58.942499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-99048ea8-3752-46f3-8d36-9226a1982f68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:58.942948 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-99048ea8-3752-46f3-8d36-9226a1982f68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:58.943739 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-99048ea8-3752-46f3-8d36-9226a1982f68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:58.944172 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-99048ea8-3752-46f3-8d36-9226a1982f68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:58.973868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-99048ea8-3752-46f3-8d36-9226a1982f68 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/ips" status: 200 len: 146 microversion: 2.1 time: 0.211500 Jul 18 08:51:58.974581 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 355/704] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 08:51:58 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/ips => generated 146 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:59.046749 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-080966eb-9545-4645-88b6-e73329607600 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] Calling method '.version_select at 0x7fafb72a4940>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:59.096242 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-080966eb-9545-4645-88b6-e73329607600 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/2801b965-69b0-4f8b-b1d6-74d594808f23" status: 200 len: 351 microversion: 2.1 time: 0.053138 Jul 18 08:51:59.096812 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 350/705] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:51:59 2022] GET /compute/v2.1/os-volumes/2801b965-69b0-4f8b-b1d6-74d594808f23 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:51:59.743663 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2c70d6eb-31ec-4b28-aa8c-1add67514e9a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:51:59.746339 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-2c70d6eb-31ec-4b28-aa8c-1add67514e9a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:51:59.754307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2c70d6eb-31ec-4b28-aa8c-1add67514e9a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:59.754775 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2c70d6eb-31ec-4b28-aa8c-1add67514e9a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:59.755605 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2c70d6eb-31ec-4b28-aa8c-1add67514e9a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:51:59.756072 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2c70d6eb-31ec-4b28-aa8c-1add67514e9a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:51:59.902404 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2c70d6eb-31ec-4b28-aa8c-1add67514e9a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:59.911399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2c70d6eb-31ec-4b28-aa8c-1add67514e9a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:59.912949 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2c70d6eb-31ec-4b28-aa8c-1add67514e9a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:51:59.914226 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2c70d6eb-31ec-4b28-aa8c-1add67514e9a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.174371 Jul 18 08:51:59.914713 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 356/706] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:51:59 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:00.859766 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-caf716bd-f585-48f0-8d41-9ceec6ca97b5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df057fe8-fb75-4122-a477-756d96db10ea"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:00.861405 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-caf716bd-f585-48f0-8d41-9ceec6ca97b5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:00.867497 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-caf716bd-f585-48f0-8d41-9ceec6ca97b5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:00.868184 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-caf716bd-f585-48f0-8d41-9ceec6ca97b5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:00.868746 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-caf716bd-f585-48f0-8d41-9ceec6ca97b5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:00.869185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-caf716bd-f585-48f0-8d41-9ceec6ca97b5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:00.921451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-59f8cbb6-bcc2-4917-9d98-6334ad0e9b94 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] Calling method '.version_select at 0x7fafb70e5280>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:00.975326 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-59f8cbb6-bcc2-4917-9d98-6334ad0e9b94 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/140cd1ed-0acd-42b7-9262-75ff20e38443" status: 200 len: 351 microversion: 2.1 time: 0.057657 Jul 18 08:52:00.975949 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 357/707] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:52:00 2022] GET /compute/v2.1/os-volumes/140cd1ed-0acd-42b7-9262-75ff20e38443 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:52:00.983812 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-aea07223-5619-4d96-9c61-7a6f8257ef14 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:00.983812 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-aea07223-5619-4d96-9c61-7a6f8257ef14 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:00.989157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aea07223-5619-4d96-9c61-7a6f8257ef14 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:00.989668 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aea07223-5619-4d96-9c61-7a6f8257ef14 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:00.990356 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aea07223-5619-4d96-9c61-7a6f8257ef14 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:00.990789 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-aea07223-5619-4d96-9c61-7a6f8257ef14 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:01.132565 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-aea07223-5619-4d96-9c61-7a6f8257ef14 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:01.140703 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-aea07223-5619-4d96-9c61-7a6f8257ef14 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:01.142226 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-aea07223-5619-4d96-9c61-7a6f8257ef14 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:01.143399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-aea07223-5619-4d96-9c61-7a6f8257ef14 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.166523 Jul 18 08:52:01.144080 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 358/708] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:00 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:01.649754 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-caf716bd-f585-48f0-8d41-9ceec6ca97b5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "POST /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.793813 Jul 18 08:52:01.650186 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 351/709] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:52:00 2022] POST /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments => generated 194 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:02.161980 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-4670d8a3-2e40-415a-9a00-60418aef5d0f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:02.162604 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-4670d8a3-2e40-415a-9a00-60418aef5d0f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:02.169346 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4670d8a3-2e40-415a-9a00-60418aef5d0f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:02.169844 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4670d8a3-2e40-415a-9a00-60418aef5d0f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:02.170616 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4670d8a3-2e40-415a-9a00-60418aef5d0f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:02.171060 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4670d8a3-2e40-415a-9a00-60418aef5d0f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:02.303087 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-4670d8a3-2e40-415a-9a00-60418aef5d0f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:02.311078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-4670d8a3-2e40-415a-9a00-60418aef5d0f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:02.314781 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-4670d8a3-2e40-415a-9a00-60418aef5d0f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:02.314781 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-4670d8a3-2e40-415a-9a00-60418aef5d0f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.155972 Jul 18 08:52:02.315166 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 359/710] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:02 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:02.652386 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2f18a7da-0899-4eef-9ea6-5d6fd42eddd6 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] Calling method '.version_select at 0x7fafb71abdc0>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:02.702558 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2f18a7da-0899-4eef-9ea6-5d6fd42eddd6 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/64972b99-367b-4e2f-bc02-d07433df4fc8" status: 200 len: 350 microversion: 2.1 time: 0.054235 Jul 18 08:52:02.705044 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 352/711] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:52:02 2022] GET /compute/v2.1/os-volumes/64972b99-367b-4e2f-bc02-d07433df4fc8 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:02.714971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-15922b3c-3739-475e-adc3-81ae1b0fe45a tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] Calling method '.version_select at 0x7fafb70843a0>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:02.799467 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-15922b3c-3739-475e-adc3-81ae1b0fe45a tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088332 Jul 18 08:52:02.800162 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 360/712] 10.222.0.57 () {58 vars in 1133 bytes} [Mon Jul 18 08:52:02 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:02.812357 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7cdefc61-499c-4e76-832b-e5b036872ed2 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] Calling method '.version_select at 0x7fafb72a4a60>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:02.896486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7cdefc61-499c-4e76-832b-e5b036872ed2 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087768 Jul 18 08:52:02.897128 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 353/713] 10.222.0.57 () {58 vars in 1148 bytes} [Mon Jul 18 08:52:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:02.910207 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-19b4857d-b507-41ac-b1e8-15e0e7fb6f3c tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] Calling method '.version_select at 0x7fafb70f1700>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:03.156317 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-19b4857d-b507-41ac-b1e8-15e0e7fb6f3c tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.250792 Jul 18 08:52:03.156892 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 361/714] 10.222.0.57 () {58 vars in 1133 bytes} [Mon Jul 18 08:52:02 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:03.168142 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-145a711f-47c7-4fd6-80b6-a0431677a6a5 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] Calling method '.version_select at 0x7fafb72a49d0>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:03.248182 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-145a711f-47c7-4fd6-80b6-a0431677a6a5 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083874 Jul 18 08:52:03.248782 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 354/715] 10.222.0.57 () {58 vars in 1166 bytes} [Mon Jul 18 08:52:03 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:03.261312 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0767604a-ba7e-410e-b21b-9fdb649e1ccf tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] Calling method '.version_select at 0x7fafb709d0d0>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:03.333899 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d0fbc9c7-795d-4959-b74e-5c48f6dbcb65 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:03.334642 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d0fbc9c7-795d-4959-b74e-5c48f6dbcb65 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:03.341221 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d0fbc9c7-795d-4959-b74e-5c48f6dbcb65 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:03.341671 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d0fbc9c7-795d-4959-b74e-5c48f6dbcb65 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:03.342442 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d0fbc9c7-795d-4959-b74e-5c48f6dbcb65 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:03.342876 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d0fbc9c7-795d-4959-b74e-5c48f6dbcb65 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:03.344168 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0767604a-ba7e-410e-b21b-9fdb649e1ccf tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086917 Jul 18 08:52:03.344747 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 362/716] 10.222.0.57 () {58 vars in 1169 bytes} [Mon Jul 18 08:52:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:03.356747 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-54c4a984-5242-43e1-9356-1966828c61f5 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] Calling method '.version_select at 0x7fafb70f1160>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:03.440553 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-54c4a984-5242-43e1-9356-1966828c61f5 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087238 Jul 18 08:52:03.441130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 363/717] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 08:52:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:52:03.451817 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-fc6c816f-c28b-4fa3-89de-495c7fc084a0 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] Calling method '.version_select at 0x7fafb70848b0>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:03.477761 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d0fbc9c7-795d-4959-b74e-5c48f6dbcb65 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:03.486821 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d0fbc9c7-795d-4959-b74e-5c48f6dbcb65 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:03.488462 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d0fbc9c7-795d-4959-b74e-5c48f6dbcb65 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:03.489726 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d0fbc9c7-795d-4959-b74e-5c48f6dbcb65 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.160370 Jul 18 08:52:03.490368 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 355/718] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:03 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:52:03.536429 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-fc6c816f-c28b-4fa3-89de-495c7fc084a0 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088115 Jul 18 08:52:03.536999 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 364/719] 10.222.0.57 () {58 vars in 1187 bytes} [Mon Jul 18 08:52:03 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:52:03.548402 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2d10a3bc-185f-45bc-971b-04bebe1737b5 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] Calling method '.version_select at 0x7fafb72a4c10>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:03.629707 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2d10a3bc-185f-45bc-971b-04bebe1737b5 tempest-VolumesTestJSON-1941615604 tempest-VolumesTestJSON-1941615604-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085044 Jul 18 08:52:03.630282 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 356/720] 10.222.0.57 () {58 vars in 1154 bytes} [Mon Jul 18 08:52:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:52:04.509613 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-800c1576-cbfe-4de2-8cac-b21a0a087ff0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:04.510319 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-800c1576-cbfe-4de2-8cac-b21a0a087ff0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:04.517410 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-800c1576-cbfe-4de2-8cac-b21a0a087ff0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:04.517871 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-800c1576-cbfe-4de2-8cac-b21a0a087ff0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:04.519154 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-800c1576-cbfe-4de2-8cac-b21a0a087ff0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:04.519154 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-800c1576-cbfe-4de2-8cac-b21a0a087ff0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:04.664490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-800c1576-cbfe-4de2-8cac-b21a0a087ff0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:04.672609 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-800c1576-cbfe-4de2-8cac-b21a0a087ff0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:04.674728 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-800c1576-cbfe-4de2-8cac-b21a0a087ff0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:04.675933 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-800c1576-cbfe-4de2-8cac-b21a0a087ff0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.170815 Jul 18 08:52:04.676508 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 365/721] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:04 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:05.695420 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-13ae8b95-b2a1-4e5f-921e-cdbbe47fabce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:05.696058 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-13ae8b95-b2a1-4e5f-921e-cdbbe47fabce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:05.703322 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-13ae8b95-b2a1-4e5f-921e-cdbbe47fabce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:05.703816 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-13ae8b95-b2a1-4e5f-921e-cdbbe47fabce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:05.705363 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-13ae8b95-b2a1-4e5f-921e-cdbbe47fabce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:05.705832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-13ae8b95-b2a1-4e5f-921e-cdbbe47fabce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:05.840493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-13ae8b95-b2a1-4e5f-921e-cdbbe47fabce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:05.848910 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-13ae8b95-b2a1-4e5f-921e-cdbbe47fabce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:05.850504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-13ae8b95-b2a1-4e5f-921e-cdbbe47fabce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:05.851683 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-13ae8b95-b2a1-4e5f-921e-cdbbe47fabce tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.161067 Jul 18 08:52:05.852278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 357/722] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:05 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:06.870659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2805b352-80eb-47c1-9f99-152c5202c11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:06.871301 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-2805b352-80eb-47c1-9f99-152c5202c11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:06.878354 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2805b352-80eb-47c1-9f99-152c5202c11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:06.878803 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2805b352-80eb-47c1-9f99-152c5202c11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:06.879561 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2805b352-80eb-47c1-9f99-152c5202c11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:06.880044 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2805b352-80eb-47c1-9f99-152c5202c11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:07.021120 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2805b352-80eb-47c1-9f99-152c5202c11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:07.029689 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2805b352-80eb-47c1-9f99-152c5202c11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:07.031181 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2805b352-80eb-47c1-9f99-152c5202c11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:07.032377 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2805b352-80eb-47c1-9f99-152c5202c11b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.165791 Jul 18 08:52:07.033721 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 366/723] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:06 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:08.053306 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-aaf1f984-c185-43a3-8e2c-bae3bc038285 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:08.053867 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-aaf1f984-c185-43a3-8e2c-bae3bc038285 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:08.060796 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aaf1f984-c185-43a3-8e2c-bae3bc038285 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:08.061246 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aaf1f984-c185-43a3-8e2c-bae3bc038285 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:08.062667 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aaf1f984-c185-43a3-8e2c-bae3bc038285 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:08.063199 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-aaf1f984-c185-43a3-8e2c-bae3bc038285 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:08.267778 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-aaf1f984-c185-43a3-8e2c-bae3bc038285 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:08.276839 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-aaf1f984-c185-43a3-8e2c-bae3bc038285 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:08.278317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-aaf1f984-c185-43a3-8e2c-bae3bc038285 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:08.279486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-aaf1f984-c185-43a3-8e2c-bae3bc038285 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.231838 Jul 18 08:52:08.280083 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 358/724] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:08 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:52:09.205712 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a618289d-0d79-4db0-a6d8-91c3c51b727b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:09.206819 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a618289d-0d79-4db0-a6d8-91c3c51b727b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:09.214282 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a618289d-0d79-4db0-a6d8-91c3c51b727b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:09.214746 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a618289d-0d79-4db0-a6d8-91c3c51b727b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:09.215557 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a618289d-0d79-4db0-a6d8-91c3c51b727b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:09.216052 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a618289d-0d79-4db0-a6d8-91c3c51b727b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:09.251301 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a618289d-0d79-4db0-a6d8-91c3c51b727b tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054744 Jul 18 08:52:09.252864 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 367/725] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:52:09 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:09.265702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8cef27af-cda7-421e-94fd-f01488b9d85c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:09.266512 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8cef27af-cda7-421e-94fd-f01488b9d85c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:09.269337 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:09.274307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cef27af-cda7-421e-94fd-f01488b9d85c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:09.274965 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cef27af-cda7-421e-94fd-f01488b9d85c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:09.276077 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cef27af-cda7-421e-94fd-f01488b9d85c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:09.277847 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8cef27af-cda7-421e-94fd-f01488b9d85c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:09.302146 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-664d507f-df04-4e1e-8fd7-d0eca81ebd51 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:09.302950 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-664d507f-df04-4e1e-8fd7-d0eca81ebd51 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:09.307385 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:09.310569 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-664d507f-df04-4e1e-8fd7-d0eca81ebd51 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:09.311482 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-664d507f-df04-4e1e-8fd7-d0eca81ebd51 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:09.312325 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-664d507f-df04-4e1e-8fd7-d0eca81ebd51 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:09.312539 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8cef27af-cda7-421e-94fd-f01488b9d85c tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments/df057fe8-fb75-4122-a477-756d96db10ea" status: 200 len: 194 microversion: 2.1 time: 0.051073 Jul 18 08:52:09.312773 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-664d507f-df04-4e1e-8fd7-d0eca81ebd51 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:09.313670 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 359/726] 10.222.0.57 () {58 vars in 1412 bytes} [Mon Jul 18 08:52:09 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments/df057fe8-fb75-4122-a477-756d96db10ea => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:09.316504 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=100 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:09.488927 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-664d507f-df04-4e1e-8fd7-d0eca81ebd51 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:09.503451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-664d507f-df04-4e1e-8fd7-d0eca81ebd51 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:09.506514 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-664d507f-df04-4e1e-8fd7-d0eca81ebd51 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:09.508890 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-664d507f-df04-4e1e-8fd7-d0eca81ebd51 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.213073 Jul 18 08:52:09.519699 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 368/727] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:09 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:10.529574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ab9859bf-1aad-41ed-b5fd-83515ec22c7b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:10.530315 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ab9859bf-1aad-41ed-b5fd-83515ec22c7b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:10.538206 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ab9859bf-1aad-41ed-b5fd-83515ec22c7b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:10.538651 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ab9859bf-1aad-41ed-b5fd-83515ec22c7b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:10.539415 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ab9859bf-1aad-41ed-b5fd-83515ec22c7b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:10.539889 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ab9859bf-1aad-41ed-b5fd-83515ec22c7b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:10.694830 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ab9859bf-1aad-41ed-b5fd-83515ec22c7b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:10.704845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ab9859bf-1aad-41ed-b5fd-83515ec22c7b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:10.707625 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ab9859bf-1aad-41ed-b5fd-83515ec22c7b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:10.708258 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ab9859bf-1aad-41ed-b5fd-83515ec22c7b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.183414 Jul 18 08:52:10.708835 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 360/728] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:10 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:11.320552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e45bae44-923f-4d22-8e96-8222014dc4ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3e86c08-878a-4895-8422-b8e3afe2cd25"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:11.322515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e45bae44-923f-4d22-8e96-8222014dc4ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:11.336221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e45bae44-923f-4d22-8e96-8222014dc4ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:11.337058 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e45bae44-923f-4d22-8e96-8222014dc4ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:11.338492 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e45bae44-923f-4d22-8e96-8222014dc4ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:11.339307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e45bae44-923f-4d22-8e96-8222014dc4ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:11.728531 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-972a1efc-d944-4a4d-a27c-3b9c385565c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:11.729778 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-972a1efc-d944-4a4d-a27c-3b9c385565c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:11.738901 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-972a1efc-d944-4a4d-a27c-3b9c385565c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:11.739886 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-972a1efc-d944-4a4d-a27c-3b9c385565c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:11.740162 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-972a1efc-d944-4a4d-a27c-3b9c385565c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:11.740753 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-972a1efc-d944-4a4d-a27c-3b9c385565c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:11.932442 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-972a1efc-d944-4a4d-a27c-3b9c385565c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:11.942431 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-972a1efc-d944-4a4d-a27c-3b9c385565c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:11.944174 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-972a1efc-d944-4a4d-a27c-3b9c385565c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:11.945574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-972a1efc-d944-4a4d-a27c-3b9c385565c1 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.222621 Jul 18 08:52:11.946096 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 361/729] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:11 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:12.254713 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e45bae44-923f-4d22-8e96-8222014dc4ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "POST /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.942542 Jul 18 08:52:12.255443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 369/730] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:52:11 2022] POST /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments => generated 194 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:12.977453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e17fde39-6896-4a84-8fe2-aba62703a477 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:12.978615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e17fde39-6896-4a84-8fe2-aba62703a477 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:12.990325 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e17fde39-6896-4a84-8fe2-aba62703a477 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:12.991128 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e17fde39-6896-4a84-8fe2-aba62703a477 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:12.992880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e17fde39-6896-4a84-8fe2-aba62703a477 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:12.993671 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e17fde39-6896-4a84-8fe2-aba62703a477 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:13.470410 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e17fde39-6896-4a84-8fe2-aba62703a477 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:13.480390 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e17fde39-6896-4a84-8fe2-aba62703a477 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:13.482478 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e17fde39-6896-4a84-8fe2-aba62703a477 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:13.483874 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e17fde39-6896-4a84-8fe2-aba62703a477 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1746 microversion: 2.20 time: 0.513579 Jul 18 08:52:13.484734 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 362/731] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:12 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1746 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:14.510192 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-09050d5d-f598-42ff-8e25-3023de400379 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:14.511064 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-09050d5d-f598-42ff-8e25-3023de400379 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:14.518091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09050d5d-f598-42ff-8e25-3023de400379 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:14.518547 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09050d5d-f598-42ff-8e25-3023de400379 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:14.519334 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09050d5d-f598-42ff-8e25-3023de400379 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:14.519800 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09050d5d-f598-42ff-8e25-3023de400379 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:14.665658 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-09050d5d-f598-42ff-8e25-3023de400379 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:14.675013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-09050d5d-f598-42ff-8e25-3023de400379 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:14.675996 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-09050d5d-f598-42ff-8e25-3023de400379 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:14.677352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-09050d5d-f598-42ff-8e25-3023de400379 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1746 microversion: 2.20 time: 0.172301 Jul 18 08:52:14.677917 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 370/732] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:14 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:15.699048 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2f68fd4f-2d6c-4955-a18a-0134044d2eaf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:15.699747 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2f68fd4f-2d6c-4955-a18a-0134044d2eaf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:15.708739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f68fd4f-2d6c-4955-a18a-0134044d2eaf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:15.708739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f68fd4f-2d6c-4955-a18a-0134044d2eaf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:15.708739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f68fd4f-2d6c-4955-a18a-0134044d2eaf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:15.709089 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f68fd4f-2d6c-4955-a18a-0134044d2eaf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:15.874437 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2f68fd4f-2d6c-4955-a18a-0134044d2eaf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:15.883628 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2f68fd4f-2d6c-4955-a18a-0134044d2eaf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:15.885185 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2f68fd4f-2d6c-4955-a18a-0134044d2eaf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:15.886396 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2f68fd4f-2d6c-4955-a18a-0134044d2eaf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.191947 Jul 18 08:52:15.887283 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 363/733] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:15 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:16.932782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a3492ca6-b1d9-4a93-be38-40129cc1e05f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:16.938788 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a3492ca6-b1d9-4a93-be38-40129cc1e05f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:16.966533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3492ca6-b1d9-4a93-be38-40129cc1e05f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:16.968095 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3492ca6-b1d9-4a93-be38-40129cc1e05f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:16.972831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3492ca6-b1d9-4a93-be38-40129cc1e05f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:16.973792 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3492ca6-b1d9-4a93-be38-40129cc1e05f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:17.198715 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a3492ca6-b1d9-4a93-be38-40129cc1e05f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:17.212421 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a3492ca6-b1d9-4a93-be38-40129cc1e05f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:17.214348 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a3492ca6-b1d9-4a93-be38-40129cc1e05f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:17.215898 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a3492ca6-b1d9-4a93-be38-40129cc1e05f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.296560 Jul 18 08:52:17.216907 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 371/734] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:16 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:18.001179 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b8b87d83-6ae3-454c-b868-0a8fece1909b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-770594222"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:18.004561 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b8b87d83-6ae3-454c-b868-0a8fece1909b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:18.010182 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b8b87d83-6ae3-454c-b868-0a8fece1909b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:18.011210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b8b87d83-6ae3-454c-b868-0a8fece1909b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:18.012490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b8b87d83-6ae3-454c-b868-0a8fece1909b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:18.013458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b8b87d83-6ae3-454c-b868-0a8fece1909b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:18.191150 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.network.security_group_api [None req-b8b87d83-6ae3-454c-b868-0a8fece1909b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Removing security group 70dff4e9-152c-49aa-8332-cd8d6ea76c8f from port 2b862c2d-6596-4494-b33e-d23be8bd6301 Jul 18 08:52:18.234531 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-76156732-23f2-4a47-8315-af46c967960e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:18.236972 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-76156732-23f2-4a47-8315-af46c967960e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:18.249578 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76156732-23f2-4a47-8315-af46c967960e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:18.250039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76156732-23f2-4a47-8315-af46c967960e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:18.250834 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76156732-23f2-4a47-8315-af46c967960e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:18.251886 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76156732-23f2-4a47-8315-af46c967960e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:18.413252 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-76156732-23f2-4a47-8315-af46c967960e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:18.437246 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-76156732-23f2-4a47-8315-af46c967960e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:18.443954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-76156732-23f2-4a47-8315-af46c967960e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:18.452512 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-76156732-23f2-4a47-8315-af46c967960e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.220940 Jul 18 08:52:18.454979 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 372/735] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:18 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:52:19.082901 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-165478e6-6f10-4274-abb9-1f29846da1fc req-e5e568ee-9e80-45de-8233-552ccbeb46f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18040578-a916-4929-ae00-067b0441f8e7", "name": "network-vif-plugged", "status": "completed", "tag": "87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:19.100084 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-165478e6-6f10-4274-abb9-1f29846da1fc req-e5e568ee-9e80-45de-8233-552ccbeb46f4 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:19.100774 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-165478e6-6f10-4274-abb9-1f29846da1fc req-e5e568ee-9e80-45de-8233-552ccbeb46f4 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:19.114181 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b8b87d83-6ae3-454c-b868-0a8fece1909b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "POST /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/action" status: 202 len: 0 microversion: 2.1 time: 1.117164 Jul 18 08:52:19.116101 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 364/736] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:52:17 2022] POST /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/action => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:52:19.117061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-165478e6-6f10-4274-abb9-1f29846da1fc req-e5e568ee-9e80-45de-8233-552ccbeb46f4 service nova] Creating event network-vif-plugged:87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd for instance 18040578-a916-4929-ae00-067b0441f8e7 on hv-cinder-85014 Jul 18 08:52:19.134773 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-165478e6-6f10-4274-abb9-1f29846da1fc req-e5e568ee-9e80-45de-8233-552ccbeb46f4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.437276 Jul 18 08:52:19.138791 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 373/737] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:52:19.180947 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-d2159e35-2092-43a2-bc0f-38ce8e26c1e9 req-6e74ec37-94bd-412e-8520-1dfac6c1a4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb91124-0b62-4d50-985e-b3e73389fe4e", "tag": "2b862c2d-6596-4494-b33e-d23be8bd6301"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:19.247779 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-d2159e35-2092-43a2-bc0f-38ce8e26c1e9 req-6e74ec37-94bd-412e-8520-1dfac6c1a4bc service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:19.251583 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-d2159e35-2092-43a2-bc0f-38ce8e26c1e9 req-6e74ec37-94bd-412e-8520-1dfac6c1a4bc service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:19.285153 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-d2159e35-2092-43a2-bc0f-38ce8e26c1e9 req-6e74ec37-94bd-412e-8520-1dfac6c1a4bc service nova] Creating event network-changed:2b862c2d-6596-4494-b33e-d23be8bd6301 for instance 1bb91124-0b62-4d50-985e-b3e73389fe4e on hv-cinder-85014 Jul 18 08:52:19.295956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-d2159e35-2092-43a2-bc0f-38ce8e26c1e9 req-6e74ec37-94bd-412e-8520-1dfac6c1a4bc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126385 Jul 18 08:52:19.297559 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 365/738] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:19.478002 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-968d7544-46d8-40f3-b5dd-91c0e01ae175 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:19.480043 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-968d7544-46d8-40f3-b5dd-91c0e01ae175 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:19.491574 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-968d7544-46d8-40f3-b5dd-91c0e01ae175 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:19.492551 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-968d7544-46d8-40f3-b5dd-91c0e01ae175 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:19.493638 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-968d7544-46d8-40f3-b5dd-91c0e01ae175 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:19.494231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-968d7544-46d8-40f3-b5dd-91c0e01ae175 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:19.654956 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-968d7544-46d8-40f3-b5dd-91c0e01ae175 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:19.666524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-968d7544-46d8-40f3-b5dd-91c0e01ae175 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:19.668133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-968d7544-46d8-40f3-b5dd-91c0e01ae175 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:19.669596 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-968d7544-46d8-40f3-b5dd-91c0e01ae175 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.199461 Jul 18 08:52:19.670166 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 374/739] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:19 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:20.702208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a90a23fd-52f0-42cc-8269-4f3ca48ee9d7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:20.706661 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a90a23fd-52f0-42cc-8269-4f3ca48ee9d7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:20.713629 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a90a23fd-52f0-42cc-8269-4f3ca48ee9d7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:20.714357 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a90a23fd-52f0-42cc-8269-4f3ca48ee9d7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:20.715317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a90a23fd-52f0-42cc-8269-4f3ca48ee9d7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:20.715971 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a90a23fd-52f0-42cc-8269-4f3ca48ee9d7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:20.929334 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a90a23fd-52f0-42cc-8269-4f3ca48ee9d7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:20.940606 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a90a23fd-52f0-42cc-8269-4f3ca48ee9d7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:20.942452 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a90a23fd-52f0-42cc-8269-4f3ca48ee9d7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:20.943695 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a90a23fd-52f0-42cc-8269-4f3ca48ee9d7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.257976 Jul 18 08:52:20.945068 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 366/740] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:20 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:21.021497 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-fbcfdada-d8ce-4f57-9bbb-3ac9a80fcf30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:21.022949 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-fbcfdada-d8ce-4f57-9bbb-3ac9a80fcf30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:21.037270 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fbcfdada-d8ce-4f57-9bbb-3ac9a80fcf30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.040523 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fbcfdada-d8ce-4f57-9bbb-3ac9a80fcf30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.042336 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fbcfdada-d8ce-4f57-9bbb-3ac9a80fcf30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.042724 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fbcfdada-d8ce-4f57-9bbb-3ac9a80fcf30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.105478 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-fbcfdada-d8ce-4f57-9bbb-3ac9a80fcf30 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.091278 Jul 18 08:52:21.111130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 375/741] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:52:21 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:21.271009 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a0b22339-2e2a-4034-aae7-9f07f0baa44a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:21.274295 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a0b22339-2e2a-4034-aae7-9f07f0baa44a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:21.295574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a0b22339-2e2a-4034-aae7-9f07f0baa44a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.297086 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a0b22339-2e2a-4034-aae7-9f07f0baa44a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.305472 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f155c8d1-23a2-48ec-9814-a6a17afab419 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:21.306201 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f155c8d1-23a2-48ec-9814-a6a17afab419 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:21.314630 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a0b22339-2e2a-4034-aae7-9f07f0baa44a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.317570 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f155c8d1-23a2-48ec-9814-a6a17afab419 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.318032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f155c8d1-23a2-48ec-9814-a6a17afab419 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.318827 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f155c8d1-23a2-48ec-9814-a6a17afab419 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.319279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f155c8d1-23a2-48ec-9814-a6a17afab419 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.322545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a0b22339-2e2a-4034-aae7-9f07f0baa44a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.409854 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a0b22339-2e2a-4034-aae7-9f07f0baa44a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments/df057fe8-fb75-4122-a477-756d96db10ea" status: 200 len: 194 microversion: 2.1 time: 0.146321 Jul 18 08:52:21.413768 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 367/742] 10.222.0.57 () {58 vars in 1412 bytes} [Mon Jul 18 08:52:21 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments/df057fe8-fb75-4122-a477-756d96db10ea => generated 194 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:21.422299 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-fd3bf82c-9ac7-4bf3-84fc-f5d7a242f566 req-6347276b-d950-4ea3-9fcf-cd64d7a5a15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb91124-0b62-4d50-985e-b3e73389fe4e", "tag": "2b862c2d-6596-4494-b33e-d23be8bd6301"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:21.435834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-fd3bf82c-9ac7-4bf3-84fc-f5d7a242f566 req-6347276b-d950-4ea3-9fcf-cd64d7a5a15a service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.437159 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-fd3bf82c-9ac7-4bf3-84fc-f5d7a242f566 req-6347276b-d950-4ea3-9fcf-cd64d7a5a15a service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.453050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-fd3bf82c-9ac7-4bf3-84fc-f5d7a242f566 req-6347276b-d950-4ea3-9fcf-cd64d7a5a15a service nova] Creating event network-changed:2b862c2d-6596-4494-b33e-d23be8bd6301 for instance 1bb91124-0b62-4d50-985e-b3e73389fe4e on hv-cinder-85014 Jul 18 08:52:21.460879 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-fd3bf82c-9ac7-4bf3-84fc-f5d7a242f566 req-6347276b-d950-4ea3-9fcf-cd64d7a5a15a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045726 Jul 18 08:52:21.461685 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 368/743] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:21.468314 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-724ad5f3-afc6-47e6-ac3e-00a1bcbacbd1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:21.468949 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-724ad5f3-afc6-47e6-ac3e-00a1bcbacbd1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:21.479933 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-724ad5f3-afc6-47e6-ac3e-00a1bcbacbd1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.480485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-724ad5f3-afc6-47e6-ac3e-00a1bcbacbd1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.481579 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-724ad5f3-afc6-47e6-ac3e-00a1bcbacbd1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.482028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-724ad5f3-afc6-47e6-ac3e-00a1bcbacbd1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.523957 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-f155c8d1-23a2-48ec-9814-a6a17afab419 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lazy-loading 'services' on Instance uuid 1bb91124-0b62-4d50-985e-b3e73389fe4e {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:52:21.796668 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f155c8d1-23a2-48ec-9814-a6a17afab419 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments/bd91af13-76d9-40d1-b4f0-0dae83578017" status: 202 len: 0 microversion: 2.1 time: 0.495709 Jul 18 08:52:21.797260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 376/744] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:52:21 2022] DELETE /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments/bd91af13-76d9-40d1-b4f0-0dae83578017 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:52:21.807856 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-09bdb99e-ddd2-47ca-9a66-b9f2a665cc3b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:21.809843 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-09bdb99e-ddd2-47ca-9a66-b9f2a665cc3b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:21.828039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09bdb99e-ddd2-47ca-9a66-b9f2a665cc3b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.830276 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09bdb99e-ddd2-47ca-9a66-b9f2a665cc3b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.832505 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09bdb99e-ddd2-47ca-9a66-b9f2a665cc3b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.832643 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09bdb99e-ddd2-47ca-9a66-b9f2a665cc3b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.841361 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-724ad5f3-afc6-47e6-ac3e-00a1bcbacbd1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lazy-loading 'services' on Instance uuid fb7d6682-c259-49a3-b61d-46ac98ff9948 {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:52:21.897327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-09bdb99e-ddd2-47ca-9a66-b9f2a665cc3b tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094348 Jul 18 08:52:21.902233 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 377/745] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:52:21 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:52:21.962650 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6201a914-4779-4363-aa19-303017b373dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:21.963258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6201a914-4779-4363-aa19-303017b373dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:21.975742 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6201a914-4779-4363-aa19-303017b373dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.976460 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6201a914-4779-4363-aa19-303017b373dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:21.977428 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6201a914-4779-4363-aa19-303017b373dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:21.978032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6201a914-4779-4363-aa19-303017b373dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:22.164236 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-724ad5f3-afc6-47e6-ac3e-00a1bcbacbd1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments/df057fe8-fb75-4122-a477-756d96db10ea" status: 202 len: 0 microversion: 2.1 time: 0.700894 Jul 18 08:52:22.168992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 369/746] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:52:21 2022] DELETE /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments/df057fe8-fb75-4122-a477-756d96db10ea => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:52:22.242236 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6201a914-4779-4363-aa19-303017b373dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:22.254920 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6201a914-4779-4363-aa19-303017b373dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:22.256718 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6201a914-4779-4363-aa19-303017b373dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:22.257790 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6201a914-4779-4363-aa19-303017b373dc tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.299122 Jul 18 08:52:22.269630 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 378/747] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:21 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:52:22.913098 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d1a73b74-03a9-4b02-935a-cb66b24bc3b7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:22.915166 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d1a73b74-03a9-4b02-935a-cb66b24bc3b7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:22.925019 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d1a73b74-03a9-4b02-935a-cb66b24bc3b7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:22.925482 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d1a73b74-03a9-4b02-935a-cb66b24bc3b7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:22.926512 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d1a73b74-03a9-4b02-935a-cb66b24bc3b7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:22.927310 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d1a73b74-03a9-4b02-935a-cb66b24bc3b7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:22.967897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d1a73b74-03a9-4b02-935a-cb66b24bc3b7 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061114 Jul 18 08:52:22.968758 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 370/748] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:52:22 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:23.292184 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-76e6bffa-76bf-4d75-8473-448fc8658646 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:23.292897 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-76e6bffa-76bf-4d75-8473-448fc8658646 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:23.295347 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=54 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:23.310215 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76e6bffa-76bf-4d75-8473-448fc8658646 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:23.310739 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76e6bffa-76bf-4d75-8473-448fc8658646 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:23.311619 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76e6bffa-76bf-4d75-8473-448fc8658646 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:23.312030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76e6bffa-76bf-4d75-8473-448fc8658646 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:23.534667 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-76e6bffa-76bf-4d75-8473-448fc8658646 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:23.544617 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-76e6bffa-76bf-4d75-8473-448fc8658646 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:23.546203 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-76e6bffa-76bf-4d75-8473-448fc8658646 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:23.547403 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-76e6bffa-76bf-4d75-8473-448fc8658646 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.266230 Jul 18 08:52:23.548559 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 379/749] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:23 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:23.980739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3fbebb14-a944-4b9d-ac96-bb37440f1cb0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:23.981785 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3fbebb14-a944-4b9d-ac96-bb37440f1cb0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:23.988903 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3fbebb14-a944-4b9d-ac96-bb37440f1cb0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:23.989349 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3fbebb14-a944-4b9d-ac96-bb37440f1cb0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:23.990123 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3fbebb14-a944-4b9d-ac96-bb37440f1cb0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:23.990887 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3fbebb14-a944-4b9d-ac96-bb37440f1cb0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:24.024086 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3fbebb14-a944-4b9d-ac96-bb37440f1cb0 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047201 Jul 18 08:52:24.026641 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 371/750] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:52:23 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:52:24.569310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e4bd8b24-0d89-4666-9eee-6df3d00387c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:24.570725 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e4bd8b24-0d89-4666-9eee-6df3d00387c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:24.577947 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4bd8b24-0d89-4666-9eee-6df3d00387c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:24.578807 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4bd8b24-0d89-4666-9eee-6df3d00387c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:24.579922 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4bd8b24-0d89-4666-9eee-6df3d00387c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:24.580647 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4bd8b24-0d89-4666-9eee-6df3d00387c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:24.767005 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e4bd8b24-0d89-4666-9eee-6df3d00387c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:24.776873 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e4bd8b24-0d89-4666-9eee-6df3d00387c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:24.780390 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e4bd8b24-0d89-4666-9eee-6df3d00387c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:24.781976 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e4bd8b24-0d89-4666-9eee-6df3d00387c6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.217960 Jul 18 08:52:24.783544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 380/751] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:24 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:52:25.039108 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4874a08f-b003-45f7-ad2d-1384934259e9 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:25.040944 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-4874a08f-b003-45f7-ad2d-1384934259e9 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:25.053892 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4874a08f-b003-45f7-ad2d-1384934259e9 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:25.061993 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4874a08f-b003-45f7-ad2d-1384934259e9 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:25.061993 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4874a08f-b003-45f7-ad2d-1384934259e9 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:25.061993 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4874a08f-b003-45f7-ad2d-1384934259e9 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:25.096869 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-4874a08f-b003-45f7-ad2d-1384934259e9 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064534 Jul 18 08:52:25.097718 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 372/752] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:52:25 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:25.805117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7550f78e-2ad7-4b1e-a262-c5ae29c54467 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:25.806443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7550f78e-2ad7-4b1e-a262-c5ae29c54467 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:25.813231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7550f78e-2ad7-4b1e-a262-c5ae29c54467 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:25.820490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7550f78e-2ad7-4b1e-a262-c5ae29c54467 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:25.820490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7550f78e-2ad7-4b1e-a262-c5ae29c54467 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:25.820490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7550f78e-2ad7-4b1e-a262-c5ae29c54467 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:25.973338 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7550f78e-2ad7-4b1e-a262-c5ae29c54467 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:25.982385 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7550f78e-2ad7-4b1e-a262-c5ae29c54467 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:25.983912 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7550f78e-2ad7-4b1e-a262-c5ae29c54467 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:25.986339 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7550f78e-2ad7-4b1e-a262-c5ae29c54467 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.184739 Jul 18 08:52:25.986339 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 381/753] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:25 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:26.109653 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b0d24272-12c2-4add-a4f8-8be75e5112ee tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:26.112666 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b0d24272-12c2-4add-a4f8-8be75e5112ee tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:26.129249 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b0d24272-12c2-4add-a4f8-8be75e5112ee tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:26.130088 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b0d24272-12c2-4add-a4f8-8be75e5112ee tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:26.130974 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b0d24272-12c2-4add-a4f8-8be75e5112ee tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:26.131587 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b0d24272-12c2-4add-a4f8-8be75e5112ee tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:26.177183 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b0d24272-12c2-4add-a4f8-8be75e5112ee tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071741 Jul 18 08:52:26.178047 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 373/754] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:52:26 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 08:52:26.194306 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-453a2e6f-5ff6-4d69-94db-3e87349472ab tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:26.195176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-453a2e6f-5ff6-4d69-94db-3e87349472ab tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:26.207499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-453a2e6f-5ff6-4d69-94db-3e87349472ab tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:26.208665 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-453a2e6f-5ff6-4d69-94db-3e87349472ab tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:26.210473 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-453a2e6f-5ff6-4d69-94db-3e87349472ab tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:26.211279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-453a2e6f-5ff6-4d69-94db-3e87349472ab tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:26.361020 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-453a2e6f-5ff6-4d69-94db-3e87349472ab tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] HTTP exception thrown: Instance 1bb91124-0b62-4d50-985e-b3e73389fe4e is not attached to volume bd91af13-76d9-40d1-b4f0-0dae83578017 Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-453a2e6f-5ff6-4d69-94db-3e87349472ab tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Request method failure captured: Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: DELETE /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments/bd91af13-76d9-40d1-b4f0-0dae83578017 HTTP/1.1 Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R6D3K66aYUewmDyn1r_RydPhGzT9m8gQ2Q-q6i9D4FQZIaacIK5aqptly6J1o2-DWm1LRlGvqX-k4lYxfMgBtI7RVIvMSWXUepz906TzzTCIM1S2J_2Rp_u_KdjOct5ws6KRrKRF89w9b_qyt8DVxOx1sK34zWxu85PPUh7QwHJL1I Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: 0a75147b684f470890244abb41bc7d67 Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-TestMinimumBasicScenario-1990599970 Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:52:26.364521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:52:26.365936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0a75147b684f470890244abb41bc7d67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0a75147b684f470890244abb41bc7d67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0a75147b684f470890244abb41bc7d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0a75147b684f470890244abb41bc7d67", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:26.365936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-TestMinimumBasicScenario-1990599970 Jul 18 08:52:26.365936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: 0a75147b684f470890244abb41bc7d67 Jul 18 08:52:26.365936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1990599970 Jul 18 08:52:26.365936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-TestMinimumBasicScenario-1990599970-project Jul 18 08:52:26.365936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:52:26.365936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:52:26.365936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 7e134a318a264a1fb870e69de07b8db8 Jul 18 08:52:26.365936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-TestMinimumBasicScenario-1990599970-project Jul 18 08:52:26.365936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:52:26.365936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 1bb91124-0b62-4d50-985e-b3e73389fe4e is not attached to volume bd91af13-76d9-40d1-b4f0-0dae83578017 Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'server_id': '1bb91124-0b62-4d50-985e-b3e73389fe4e', 'id': 'bd91af13-76d9-40d1-b4f0-0dae83578017'} Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bd91af13-76d9-40d1-b4f0-0dae83578017. Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:26.366680 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb91124-0b62-4d50-985e-b3e73389fe4e is not attached to volume bd91af13-76d9-40d1-b4f0-0dae83578017 Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb91124-0b62-4d50-985e-b3e73389fe4e is not attached to volume bd91af13-76d9-40d1-b4f0-0dae83578017 Jul 18 08:52:26.368032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:26.371360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-453a2e6f-5ff6-4d69-94db-3e87349472ab tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Returning 404 to user: Instance 1bb91124-0b62-4d50-985e-b3e73389fe4e is not attached to volume bd91af13-76d9-40d1-b4f0-0dae83578017 {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:26.372439 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-453a2e6f-5ff6-4d69-94db-3e87349472ab tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments/bd91af13-76d9-40d1-b4f0-0dae83578017" status: 404 len: 154 microversion: 2.1 time: 0.187830 Jul 18 08:52:26.379005 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 382/755] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:52:26 2022] DELETE /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e/os-volume_attachments/bd91af13-76d9-40d1-b4f0-0dae83578017 => generated 154 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:52:27.006192 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-38a362b0-dbdf-4b6d-9da8-01cd09d0cd03 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:27.026769 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-38a362b0-dbdf-4b6d-9da8-01cd09d0cd03 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:27.026769 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-38a362b0-dbdf-4b6d-9da8-01cd09d0cd03 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:27.026769 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-38a362b0-dbdf-4b6d-9da8-01cd09d0cd03 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:27.026769 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-38a362b0-dbdf-4b6d-9da8-01cd09d0cd03 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:27.027194 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-38a362b0-dbdf-4b6d-9da8-01cd09d0cd03 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:27.165356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-38a362b0-dbdf-4b6d-9da8-01cd09d0cd03 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:27.174850 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-38a362b0-dbdf-4b6d-9da8-01cd09d0cd03 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:27.176408 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-38a362b0-dbdf-4b6d-9da8-01cd09d0cd03 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:27.177668 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-38a362b0-dbdf-4b6d-9da8-01cd09d0cd03 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.175535 Jul 18 08:52:27.178257 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 374/756] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:27 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:27.811808 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8e3c6cca-6ddd-45a5-823a-78444277c6f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:27.816319 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8e3c6cca-6ddd-45a5-823a-78444277c6f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:27.822378 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8e3c6cca-6ddd-45a5-823a-78444277c6f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:27.823157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8e3c6cca-6ddd-45a5-823a-78444277c6f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:27.826716 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8e3c6cca-6ddd-45a5-823a-78444277c6f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:27.827814 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8e3c6cca-6ddd-45a5-823a-78444277c6f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:27.855486 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:27.868263 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8e3c6cca-6ddd-45a5-823a-78444277c6f1 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments/d3e86c08-878a-4895-8422-b8e3afe2cd25" status: 200 len: 194 microversion: 2.1 time: 0.061001 Jul 18 08:52:27.868966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 383/757] 10.222.0.57 () {58 vars in 1412 bytes} [Mon Jul 18 08:52:27 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments/d3e86c08-878a-4895-8422-b8e3afe2cd25 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:27.873915 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-bb3daa87-ae89-4f1b-a643-d6499c31b6bb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:27.874771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-bb3daa87-ae89-4f1b-a643-d6499c31b6bb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:27.881988 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bb3daa87-ae89-4f1b-a643-d6499c31b6bb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:27.884545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bb3daa87-ae89-4f1b-a643-d6499c31b6bb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:27.884666 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c78b3f51-e357-4fd7-b07a-b16b242cab20 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:27.884666 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c78b3f51-e357-4fd7-b07a-b16b242cab20 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:27.884852 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bb3daa87-ae89-4f1b-a643-d6499c31b6bb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:27.884852 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bb3daa87-ae89-4f1b-a643-d6499c31b6bb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:27.895252 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c78b3f51-e357-4fd7-b07a-b16b242cab20 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:27.896132 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c78b3f51-e357-4fd7-b07a-b16b242cab20 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:27.897109 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c78b3f51-e357-4fd7-b07a-b16b242cab20 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:27.897630 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c78b3f51-e357-4fd7-b07a-b16b242cab20 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:27.915763 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-bb3daa87-ae89-4f1b-a643-d6499c31b6bb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Going to try to terminate instance {{(pid=124895) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:52:28.026365 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-c78b3f51-e357-4fd7-b07a-b16b242cab20 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lazy-loading 'services' on Instance uuid fb7d6682-c259-49a3-b61d-46ac98ff9948 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:52:28.067379 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:28.302020 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-bb3daa87-ae89-4f1b-a643-d6499c31b6bb tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 204 len: 0 microversion: 2.1 time: 0.437081 Jul 18 08:52:28.302933 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 375/758] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:52:27 2022] DELETE /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 08:52:28.309083 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-754fab4f-6287-4e5c-b05d-d5a14020d81c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:28.309802 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-754fab4f-6287-4e5c-b05d-d5a14020d81c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:28.317104 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-754fab4f-6287-4e5c-b05d-d5a14020d81c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:28.317610 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-754fab4f-6287-4e5c-b05d-d5a14020d81c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:28.318404 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-754fab4f-6287-4e5c-b05d-d5a14020d81c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:28.318847 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-754fab4f-6287-4e5c-b05d-d5a14020d81c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:28.408818 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c78b3f51-e357-4fd7-b07a-b16b242cab20 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments/d3e86c08-878a-4895-8422-b8e3afe2cd25" status: 202 len: 0 microversion: 2.1 time: 0.530304 Jul 18 08:52:28.413523 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 384/759] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:52:27 2022] DELETE /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments/d3e86c08-878a-4895-8422-b8e3afe2cd25 => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:52:28.419775 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1ea4bc80-bd58-4ca4-8cb0-b52d4915e5e8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:28.420990 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1ea4bc80-bd58-4ca4-8cb0-b52d4915e5e8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:28.433767 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1ea4bc80-bd58-4ca4-8cb0-b52d4915e5e8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:28.436917 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1ea4bc80-bd58-4ca4-8cb0-b52d4915e5e8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:28.439494 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1ea4bc80-bd58-4ca4-8cb0-b52d4915e5e8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:28.439494 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1ea4bc80-bd58-4ca4-8cb0-b52d4915e5e8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:28.518178 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-754fab4f-6287-4e5c-b05d-d5a14020d81c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:28.526927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-754fab4f-6287-4e5c-b05d-d5a14020d81c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:28.528550 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-754fab4f-6287-4e5c-b05d-d5a14020d81c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:28.529768 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-754fab4f-6287-4e5c-b05d-d5a14020d81c tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.225407 Jul 18 08:52:28.530340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 376/760] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:28 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:28.595992 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1ea4bc80-bd58-4ca4-8cb0-b52d4915e5e8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:28.603348 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1ea4bc80-bd58-4ca4-8cb0-b52d4915e5e8 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1555 microversion: 2.1 time: 0.191005 Jul 18 08:52:28.603861 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 385/761] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:28 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:29.549678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7a78eebf-2be5-4ec9-8fcf-6c98b3e39157 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:29.550325 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7a78eebf-2be5-4ec9-8fcf-6c98b3e39157 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:29.557084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7a78eebf-2be5-4ec9-8fcf-6c98b3e39157 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:29.557527 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7a78eebf-2be5-4ec9-8fcf-6c98b3e39157 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:29.558292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7a78eebf-2be5-4ec9-8fcf-6c98b3e39157 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:29.558722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7a78eebf-2be5-4ec9-8fcf-6c98b3e39157 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:29.621698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-460c629f-c8b9-4f2b-9a55-af4297eb4b46 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:29.622300 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-460c629f-c8b9-4f2b-9a55-af4297eb4b46 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:29.628855 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-460c629f-c8b9-4f2b-9a55-af4297eb4b46 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:29.634183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-460c629f-c8b9-4f2b-9a55-af4297eb4b46 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:29.634183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-460c629f-c8b9-4f2b-9a55-af4297eb4b46 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:29.634183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-460c629f-c8b9-4f2b-9a55-af4297eb4b46 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:29.705575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7a78eebf-2be5-4ec9-8fcf-6c98b3e39157 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:29.714410 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7a78eebf-2be5-4ec9-8fcf-6c98b3e39157 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:29.716094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7a78eebf-2be5-4ec9-8fcf-6c98b3e39157 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:29.717389 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7a78eebf-2be5-4ec9-8fcf-6c98b3e39157 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1741 microversion: 2.20 time: 0.171875 Jul 18 08:52:29.718412 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 377/762] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:29 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:29.781167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-460c629f-c8b9-4f2b-9a55-af4297eb4b46 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:29.790109 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-460c629f-c8b9-4f2b-9a55-af4297eb4b46 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1555 microversion: 2.1 time: 0.172372 Jul 18 08:52:29.790691 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 386/763] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:29 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:52:30.737420 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-df3c392e-9edf-4d71-9d9c-992d24b86c8a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:30.738093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-df3c392e-9edf-4d71-9d9c-992d24b86c8a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:30.751484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-df3c392e-9edf-4d71-9d9c-992d24b86c8a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:30.752517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-df3c392e-9edf-4d71-9d9c-992d24b86c8a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:30.753371 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-df3c392e-9edf-4d71-9d9c-992d24b86c8a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:30.753873 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-df3c392e-9edf-4d71-9d9c-992d24b86c8a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:30.812352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6710ff98-204c-4186-8b0f-b4773b0d4bc5 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:30.813852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6710ff98-204c-4186-8b0f-b4773b0d4bc5 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:30.824292 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6710ff98-204c-4186-8b0f-b4773b0d4bc5 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:30.824753 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6710ff98-204c-4186-8b0f-b4773b0d4bc5 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:30.826148 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6710ff98-204c-4186-8b0f-b4773b0d4bc5 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:30.826608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6710ff98-204c-4186-8b0f-b4773b0d4bc5 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:31.050702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-df3c392e-9edf-4d71-9d9c-992d24b86c8a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:31.060397 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-df3c392e-9edf-4d71-9d9c-992d24b86c8a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:31.061917 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-df3c392e-9edf-4d71-9d9c-992d24b86c8a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:31.063250 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-df3c392e-9edf-4d71-9d9c-992d24b86c8a tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1723 microversion: 2.20 time: 0.330379 Jul 18 08:52:31.063844 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 378/764] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:30 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:31.075722 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6710ff98-204c-4186-8b0f-b4773b0d4bc5 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:31.088561 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6710ff98-204c-4186-8b0f-b4773b0d4bc5 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1555 microversion: 2.1 time: 0.280559 Jul 18 08:52:31.089941 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 387/765] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:30 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1555 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:52:31.405715 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-49c29762-1a1e-415b-8f63-0e63ff41774e req-e056f802-b399-4ea5-8805-84d3cced02e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb91124-0b62-4d50-985e-b3e73389fe4e", "name": "network-vif-deleted", "tag": "2b862c2d-6596-4494-b33e-d23be8bd6301"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:31.415075 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-49c29762-1a1e-415b-8f63-0e63ff41774e req-e056f802-b399-4ea5-8805-84d3cced02e7 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:31.415520 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-49c29762-1a1e-415b-8f63-0e63ff41774e req-e056f802-b399-4ea5-8805-84d3cced02e7 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:31.429743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-49c29762-1a1e-415b-8f63-0e63ff41774e req-e056f802-b399-4ea5-8805-84d3cced02e7 service nova] Creating event network-vif-deleted:2b862c2d-6596-4494-b33e-d23be8bd6301 for instance 1bb91124-0b62-4d50-985e-b3e73389fe4e on hv-cinder-85014 Jul 18 08:52:31.436299 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-49c29762-1a1e-415b-8f63-0e63ff41774e req-e056f802-b399-4ea5-8805-84d3cced02e7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034939 Jul 18 08:52:31.436901 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 379/766] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:31.728412 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-4aaaaa1a-c5c2-47ac-bd21-89f98c0e8c5f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:31.729825 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-4aaaaa1a-c5c2-47ac-bd21-89f98c0e8c5f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:31.737645 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4aaaaa1a-c5c2-47ac-bd21-89f98c0e8c5f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:31.738096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4aaaaa1a-c5c2-47ac-bd21-89f98c0e8c5f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:31.738884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4aaaaa1a-c5c2-47ac-bd21-89f98c0e8c5f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:31.739326 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4aaaaa1a-c5c2-47ac-bd21-89f98c0e8c5f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:31.771988 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-4aaaaa1a-c5c2-47ac-bd21-89f98c0e8c5f tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050179 Jul 18 08:52:31.772782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 388/767] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:52:31 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 08:52:31.905981 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a74c21b7-e4ea-4832-9472-797a3aa35dfe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:31.907776 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a74c21b7-e4ea-4832-9472-797a3aa35dfe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:31.915464 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a74c21b7-e4ea-4832-9472-797a3aa35dfe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:31.916068 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a74c21b7-e4ea-4832-9472-797a3aa35dfe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:31.916879 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a74c21b7-e4ea-4832-9472-797a3aa35dfe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:31.917338 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a74c21b7-e4ea-4832-9472-797a3aa35dfe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:31.954607 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a74c21b7-e4ea-4832-9472-797a3aa35dfe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053546 Jul 18 08:52:31.955486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 380/768] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:52:31 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 08:52:32.019104 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6f459b2e-87cb-4a12-abb0-bec7013fe2c9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:32.019654 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6f459b2e-87cb-4a12-abb0-bec7013fe2c9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:32.026405 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6f459b2e-87cb-4a12-abb0-bec7013fe2c9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:32.026852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6f459b2e-87cb-4a12-abb0-bec7013fe2c9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:32.027625 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6f459b2e-87cb-4a12-abb0-bec7013fe2c9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:32.028098 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6f459b2e-87cb-4a12-abb0-bec7013fe2c9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:32.055645 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6f459b2e-87cb-4a12-abb0-bec7013fe2c9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:52:32.082910 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b940df57-405f-4b88-9e04-6fe3036b4408 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:32.083946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b940df57-405f-4b88-9e04-6fe3036b4408 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:32.091189 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b940df57-405f-4b88-9e04-6fe3036b4408 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:32.091737 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b940df57-405f-4b88-9e04-6fe3036b4408 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:32.092522 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b940df57-405f-4b88-9e04-6fe3036b4408 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:32.092945 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b940df57-405f-4b88-9e04-6fe3036b4408 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:32.263067 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b940df57-405f-4b88-9e04-6fe3036b4408 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:32.273243 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b940df57-405f-4b88-9e04-6fe3036b4408 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:32.274812 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b940df57-405f-4b88-9e04-6fe3036b4408 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:32.276044 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b940df57-405f-4b88-9e04-6fe3036b4408 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1723 microversion: 2.20 time: 0.197169 Jul 18 08:52:32.276611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 381/769] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:32 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:52:32.281576 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a7bfd56c-5680-48e6-ae51-eb47fbb5c869 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:32.282691 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a7bfd56c-5680-48e6-ae51-eb47fbb5c869 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:32.289400 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a7bfd56c-5680-48e6-ae51-eb47fbb5c869 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:32.289849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a7bfd56c-5680-48e6-ae51-eb47fbb5c869 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:32.290622 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a7bfd56c-5680-48e6-ae51-eb47fbb5c869 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:32.291056 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a7bfd56c-5680-48e6-ae51-eb47fbb5c869 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:32.358072 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a7bfd56c-5680-48e6-ae51-eb47fbb5c869 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:32.370968 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a7bfd56c-5680-48e6-ae51-eb47fbb5c869 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1513 microversion: 2.1 time: 0.092494 Jul 18 08:52:32.371836 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 382/770] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:32 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1513 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:32.389284 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6f459b2e-87cb-4a12-abb0-bec7013fe2c9 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 204 len: 0 microversion: 2.1 time: 0.373159 Jul 18 08:52:32.390978 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 389/771] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:52:32 2022] DELETE /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:52:32.401170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e38c7be3-4afd-4c58-934f-e0b3993a8c5e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:32.402174 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e38c7be3-4afd-4c58-934f-e0b3993a8c5e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:32.410725 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e38c7be3-4afd-4c58-934f-e0b3993a8c5e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:32.411210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e38c7be3-4afd-4c58-934f-e0b3993a8c5e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:32.412061 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e38c7be3-4afd-4c58-934f-e0b3993a8c5e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:32.412642 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e38c7be3-4afd-4c58-934f-e0b3993a8c5e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:32.566453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e38c7be3-4afd-4c58-934f-e0b3993a8c5e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:32.574647 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e38c7be3-4afd-4c58-934f-e0b3993a8c5e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1674 microversion: 2.1 time: 0.178020 Jul 18 08:52:32.575237 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 383/772] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:32 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:33.296748 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-851944ce-e298-4d88-b880-9f1167c47ff9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:33.297451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-851944ce-e298-4d88-b880-9f1167c47ff9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:33.304792 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-851944ce-e298-4d88-b880-9f1167c47ff9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:33.305245 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-851944ce-e298-4d88-b880-9f1167c47ff9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:33.306030 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-851944ce-e298-4d88-b880-9f1167c47ff9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:33.306487 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-851944ce-e298-4d88-b880-9f1167c47ff9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:33.390067 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-605094dd-ba6f-477a-b6ef-168cb0e96d92 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:33.391114 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-605094dd-ba6f-477a-b6ef-168cb0e96d92 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:33.399715 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-605094dd-ba6f-477a-b6ef-168cb0e96d92 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:33.400156 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-605094dd-ba6f-477a-b6ef-168cb0e96d92 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:33.400941 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-605094dd-ba6f-477a-b6ef-168cb0e96d92 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:33.401377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-605094dd-ba6f-477a-b6ef-168cb0e96d92 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:33.506787 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-605094dd-ba6f-477a-b6ef-168cb0e96d92 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:33.510919 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-851944ce-e298-4d88-b880-9f1167c47ff9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:33.518864 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-605094dd-ba6f-477a-b6ef-168cb0e96d92 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1343 microversion: 2.1 time: 0.133434 Jul 18 08:52:33.519988 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-851944ce-e298-4d88-b880-9f1167c47ff9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:33.522457 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-851944ce-e298-4d88-b880-9f1167c47ff9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:33.526928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-851944ce-e298-4d88-b880-9f1167c47ff9 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1723 microversion: 2.20 time: 0.231844 Jul 18 08:52:33.526928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 390/773] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:33 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:33.530370 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 384/774] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:33 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1343 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:52:33.592726 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-cdc1c120-cb95-4a1d-a295-28d3b6de643e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:33.593351 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-cdc1c120-cb95-4a1d-a295-28d3b6de643e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:33.601037 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cdc1c120-cb95-4a1d-a295-28d3b6de643e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:33.601654 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cdc1c120-cb95-4a1d-a295-28d3b6de643e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:33.602636 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cdc1c120-cb95-4a1d-a295-28d3b6de643e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:33.603200 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cdc1c120-cb95-4a1d-a295-28d3b6de643e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:33.761876 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-cdc1c120-cb95-4a1d-a295-28d3b6de643e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:33.770012 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-cdc1c120-cb95-4a1d-a295-28d3b6de643e tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1674 microversion: 2.1 time: 0.181131 Jul 18 08:52:33.770606 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 391/775] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:33 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:34.542433 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b1e6bbcf-766e-4bab-be85-d25cab7cb19e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:34.543483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b1e6bbcf-766e-4bab-be85-d25cab7cb19e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:34.553604 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8b3f2ab3-c70e-474f-af91-d373a78b3e41 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:34.554530 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b1e6bbcf-766e-4bab-be85-d25cab7cb19e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:34.555173 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b1e6bbcf-766e-4bab-be85-d25cab7cb19e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:34.556159 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b1e6bbcf-766e-4bab-be85-d25cab7cb19e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:34.556833 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b1e6bbcf-766e-4bab-be85-d25cab7cb19e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:34.573205 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8b3f2ab3-c70e-474f-af91-d373a78b3e41 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:34.583097 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b3f2ab3-c70e-474f-af91-d373a78b3e41 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:34.583557 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b3f2ab3-c70e-474f-af91-d373a78b3e41 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:34.584377 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b3f2ab3-c70e-474f-af91-d373a78b3e41 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:34.584813 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b3f2ab3-c70e-474f-af91-d373a78b3e41 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:34.594972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b1e6bbcf-766e-4bab-be85-d25cab7cb19e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:34.601010 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b1e6bbcf-766e-4bab-be85-d25cab7cb19e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:34.601010 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-b1e6bbcf-766e-4bab-be85-d25cab7cb19e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lazy-loading 'fault' on Instance uuid 1bb91124-0b62-4d50-985e-b3e73389fe4e {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:52:34.680775 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b1e6bbcf-766e-4bab-be85-d25cab7cb19e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e134a318a264a1fb870e69de07b8db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a75147b684f470890244abb41bc7d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:34.701511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b1e6bbcf-766e-4bab-be85-d25cab7cb19e tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 200 len: 1348 microversion: 2.1 time: 0.165671 Jul 18 08:52:34.704888 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 385/776] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:34 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 1348 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:34.788476 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4ff701e2-77f7-4926-ad50-adf56a0d95bc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:34.790238 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-4ff701e2-77f7-4926-ad50-adf56a0d95bc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:34.798373 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4ff701e2-77f7-4926-ad50-adf56a0d95bc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:34.799164 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4ff701e2-77f7-4926-ad50-adf56a0d95bc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:34.800464 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4ff701e2-77f7-4926-ad50-adf56a0d95bc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:34.802055 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4ff701e2-77f7-4926-ad50-adf56a0d95bc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:34.833793 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8b3f2ab3-c70e-474f-af91-d373a78b3e41 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:34.843511 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8b3f2ab3-c70e-474f-af91-d373a78b3e41 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:34.845868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8b3f2ab3-c70e-474f-af91-d373a78b3e41 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:34.847342 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8b3f2ab3-c70e-474f-af91-d373a78b3e41 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1723 microversion: 2.20 time: 0.301927 Jul 18 08:52:34.848813 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 392/777] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:34 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:34.853348 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-26379464-6e4d-486f-a344-ce97a800e88a req-5aa12d35-953e-4d6d-b75b-50b1d6592b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18040578-a916-4929-ae00-067b0441f8e7", "name": "network-vif-unplugged", "status": "completed", "tag": "87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:34.862496 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-26379464-6e4d-486f-a344-ce97a800e88a req-5aa12d35-953e-4d6d-b75b-50b1d6592b22 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:34.863042 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-26379464-6e4d-486f-a344-ce97a800e88a req-5aa12d35-953e-4d6d-b75b-50b1d6592b22 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:34.874902 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-26379464-6e4d-486f-a344-ce97a800e88a req-5aa12d35-953e-4d6d-b75b-50b1d6592b22 service nova] Creating event network-vif-unplugged:87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd for instance 18040578-a916-4929-ae00-067b0441f8e7 on hv-cinder-85014 Jul 18 08:52:34.880346 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-26379464-6e4d-486f-a344-ce97a800e88a req-5aa12d35-953e-4d6d-b75b-50b1d6592b22 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030813 Jul 18 08:52:34.890718 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 393/778] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:35.030112 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4ff701e2-77f7-4926-ad50-adf56a0d95bc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:35.047711 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-4ff701e2-77f7-4926-ad50-adf56a0d95bc tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1674 microversion: 2.1 time: 0.263926 Jul 18 08:52:35.049046 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 386/779] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:34 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1674 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:52:35.739697 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-23eabd9b-a986-4239-9aea-4daf1b949a49 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:35.744462 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-23eabd9b-a986-4239-9aea-4daf1b949a49 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] [instance: 1bb91124-0b62-4d50-985e-b3e73389fe4e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:35.756107 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-23eabd9b-a986-4239-9aea-4daf1b949a49 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:35.757392 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-23eabd9b-a986-4239-9aea-4daf1b949a49 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:35.758970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-23eabd9b-a986-4239-9aea-4daf1b949a49 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:35.759783 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-23eabd9b-a986-4239-9aea-4daf1b949a49 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:35.781366 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-23eabd9b-a986-4239-9aea-4daf1b949a49 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] HTTP exception thrown: Instance 1bb91124-0b62-4d50-985e-b3e73389fe4e could not be found. Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-23eabd9b-a986-4239-9aea-4daf1b949a49 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Request method failure captured: Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e HTTP/1.1 Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R6D3K66aYUewmDyn1r_RydPhGzT9m8gQ2Q-q6i9D4FQZIaacIK5aqptly6J1o2-DWm1LRlGvqX-k4lYxfMgBtI7RVIvMSWXUepz906TzzTCIM1S2J_2Rp_u_KdjOct5ws6KRrKRF89w9b_qyt8DVxOx1sK34zWxu85PPUh7QwHJL1I Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: 0a75147b684f470890244abb41bc7d67 Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-TestMinimumBasicScenario-1990599970 Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:52:35.785248 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0a75147b684f470890244abb41bc7d67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0a75147b684f470890244abb41bc7d67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0a75147b684f470890244abb41bc7d67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0a75147b684f470890244abb41bc7d67", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-TestMinimumBasicScenario-1990599970 Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: 0a75147b684f470890244abb41bc7d67 Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1990599970 Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-TestMinimumBasicScenario-1990599970-project Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 7e134a318a264a1fb870e69de07b8db8 Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-TestMinimumBasicScenario-1990599970-project Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 1bb91124-0b62-4d50-985e-b3e73389fe4e could not be found. Jul 18 08:52:35.788151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '1bb91124-0b62-4d50-985e-b3e73389fe4e'} Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb91124-0b62-4d50-985e-b3e73389fe4e could not be found. Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:35.789420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb91124-0b62-4d50-985e-b3e73389fe4e could not be found. Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb91124-0b62-4d50-985e-b3e73389fe4e could not be found. Jul 18 08:52:35.792399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:35.800995 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-23eabd9b-a986-4239-9aea-4daf1b949a49 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Returning 404 to user: Instance 1bb91124-0b62-4d50-985e-b3e73389fe4e could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:35.800995 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-23eabd9b-a986-4239-9aea-4daf1b949a49 tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e" status: 404 len: 111 microversion: 2.1 time: 0.068936 Jul 18 08:52:35.800995 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 394/780] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:35 2022] GET /compute/v2.1/servers/1bb91124-0b62-4d50-985e-b3e73389fe4e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 08:52:35.806672 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-48fb27f6-f247-41b9-a7ad-f5ea42010b4d tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] Calling method '.version_select at 0x7fafb71ed0d0>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:35.884877 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7a67ed3d-8e5e-44f4-ba10-b4e3b1b857d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:35.887250 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7a67ed3d-8e5e-44f4-ba10-b4e3b1b857d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:35.898761 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a67ed3d-8e5e-44f4-ba10-b4e3b1b857d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:35.899881 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a67ed3d-8e5e-44f4-ba10-b4e3b1b857d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:35.904467 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a67ed3d-8e5e-44f4-ba10-b4e3b1b857d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:35.904467 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a67ed3d-8e5e-44f4-ba10-b4e3b1b857d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:35.941285 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-48fb27f6-f247-41b9-a7ad-f5ea42010b4d tempest-TestMinimumBasicScenario-1990599970 tempest-TestMinimumBasicScenario-1990599970-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1233196404" status: 202 len: 0 microversion: 2.1 time: 0.144416 Jul 18 08:52:35.943739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 387/781] 10.222.0.57 () {58 vars in 1271 bytes} [Mon Jul 18 08:52:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1233196404 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:52:36.068894 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-cf1cbb6e-c97f-439d-ac22-5a80a77159ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:36.070915 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-cf1cbb6e-c97f-439d-ac22-5a80a77159ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:36.084560 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf1cbb6e-c97f-439d-ac22-5a80a77159ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:36.085873 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf1cbb6e-c97f-439d-ac22-5a80a77159ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:36.088323 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf1cbb6e-c97f-439d-ac22-5a80a77159ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:36.092241 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf1cbb6e-c97f-439d-ac22-5a80a77159ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:36.189691 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7a67ed3d-8e5e-44f4-ba10-b4e3b1b857d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:36.198763 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7a67ed3d-8e5e-44f4-ba10-b4e3b1b857d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:36.209799 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7a67ed3d-8e5e-44f4-ba10-b4e3b1b857d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:36.211352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7a67ed3d-8e5e-44f4-ba10-b4e3b1b857d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1666 microversion: 2.20 time: 0.340073 Jul 18 08:52:36.212014 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 395/782] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:35 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1666 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:36.224318 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-cf1cbb6e-c97f-439d-ac22-5a80a77159ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:36.231959 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e7f24f60-94b0-408b-8b67-0fc40b6d3bdf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b824d964-9e9f-4359-90e6-eca95048fe99"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:36.232494 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-cf1cbb6e-c97f-439d-ac22-5a80a77159ed tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1606 microversion: 2.1 time: 0.164813 Jul 18 08:52:36.233064 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e7f24f60-94b0-408b-8b67-0fc40b6d3bdf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:36.234492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 388/783] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:36 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1606 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:36.242143 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7f24f60-94b0-408b-8b67-0fc40b6d3bdf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:36.242863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7f24f60-94b0-408b-8b67-0fc40b6d3bdf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:36.244266 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7f24f60-94b0-408b-8b67-0fc40b6d3bdf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:36.244884 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e7f24f60-94b0-408b-8b67-0fc40b6d3bdf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:36.547228 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-9569038b-d04d-42db-976c-2f3cf60c08d6 req-21b6e8d1-f52b-4262-8db7-10b50399947b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7d6682-c259-49a3-b61d-46ac98ff9948", "name": "network-vif-deleted", "tag": "5a31bcdc-6257-4e32-bc32-f336670e10fd"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:36.568060 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-9569038b-d04d-42db-976c-2f3cf60c08d6 req-21b6e8d1-f52b-4262-8db7-10b50399947b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:36.568060 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-9569038b-d04d-42db-976c-2f3cf60c08d6 req-21b6e8d1-f52b-4262-8db7-10b50399947b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:36.588927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-9569038b-d04d-42db-976c-2f3cf60c08d6 req-21b6e8d1-f52b-4262-8db7-10b50399947b service nova] Creating event network-vif-deleted:5a31bcdc-6257-4e32-bc32-f336670e10fd for instance fb7d6682-c259-49a3-b61d-46ac98ff9948 on hv-cinder-85014 Jul 18 08:52:36.598800 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-9569038b-d04d-42db-976c-2f3cf60c08d6 req-21b6e8d1-f52b-4262-8db7-10b50399947b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058393 Jul 18 08:52:36.602942 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 389/784] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:37.251704 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-50cc57d9-912a-4db6-8c3f-1b9ff04ef82d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:37.253266 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-50cc57d9-912a-4db6-8c3f-1b9ff04ef82d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:37.260243 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50cc57d9-912a-4db6-8c3f-1b9ff04ef82d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:37.260729 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50cc57d9-912a-4db6-8c3f-1b9ff04ef82d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:37.261734 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50cc57d9-912a-4db6-8c3f-1b9ff04ef82d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:37.262334 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50cc57d9-912a-4db6-8c3f-1b9ff04ef82d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:37.300226 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50cc57d9-912a-4db6-8c3f-1b9ff04ef82d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:37.300694 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50cc57d9-912a-4db6-8c3f-1b9ff04ef82d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:37.301158 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-50cc57d9-912a-4db6-8c3f-1b9ff04ef82d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lazy-loading 'fault' on Instance uuid fb7d6682-c259-49a3-b61d-46ac98ff9948 {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:52:37.365887 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-50cc57d9-912a-4db6-8c3f-1b9ff04ef82d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94eed85a730b46dcb1cf694a3ebf2d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7367af701b84358a4e5c5d0db473b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:37.373708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-50cc57d9-912a-4db6-8c3f-1b9ff04ef82d tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 200 len: 1327 microversion: 2.1 time: 0.126858 Jul 18 08:52:37.374314 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 390/785] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:37 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:52:37.696889 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=5,nova_cell1:UPDATE=3 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:37.822006 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e7f24f60-94b0-408b-8b67-0fc40b6d3bdf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "POST /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.594187 Jul 18 08:52:37.822663 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 396/786] 10.222.0.57 () {62 vars in 1363 bytes} [Mon Jul 18 08:52:36 2022] POST /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/os-volume_attachments => generated 188 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 08:52:37.983268 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-dd46663d-bdb2-4aa1-a709-5875d8a9f8f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:37.983876 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-dd46663d-bdb2-4aa1-a709-5875d8a9f8f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:37.991818 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd46663d-bdb2-4aa1-a709-5875d8a9f8f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:37.992426 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd46663d-bdb2-4aa1-a709-5875d8a9f8f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:37.993320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd46663d-bdb2-4aa1-a709-5875d8a9f8f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:37.993843 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd46663d-bdb2-4aa1-a709-5875d8a9f8f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:38.392488 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9377a6ed-9a43-4b59-bc9c-9b33252643f5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:38.393359 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9377a6ed-9a43-4b59-bc9c-9b33252643f5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:38.400838 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9377a6ed-9a43-4b59-bc9c-9b33252643f5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:38.401374 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9377a6ed-9a43-4b59-bc9c-9b33252643f5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:38.402162 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9377a6ed-9a43-4b59-bc9c-9b33252643f5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:38.402607 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9377a6ed-9a43-4b59-bc9c-9b33252643f5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:38.418221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-9377a6ed-9a43-4b59-bc9c-9b33252643f5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] HTTP exception thrown: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9377a6ed-9a43-4b59-bc9c-9b33252643f5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Request method failure captured: Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 HTTP/1.1 Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3coSe05_vBCD8cZm6om8IgfnRk5zeZpdXZJGCQeHl482XmuHJbG5WZ-c8gvulc29ZQPXglG_5yOwm1YAeT7_UH0M_nOaLD0vaZHGGW3U_oayZrIdVKXmIaHe82CpJ0VV1R0ljRZo83d71n6qdyQJtzcX-8ir2dVmZiP1BA7VYOun0 Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:52:38.419851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d7367af701b84358a4e5c5d0db473b44", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 94eed85a730b46dcb1cf694a3ebf2d3a Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:38.421388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': 'fb7d6682-c259-49a3-b61d-46ac98ff9948'} Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:38.422157 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:38.425251 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:38.426746 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9377a6ed-9a43-4b59-bc9c-9b33252643f5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Returning 404 to user: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:38.426746 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9377a6ed-9a43-4b59-bc9c-9b33252643f5 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 404 len: 111 microversion: 2.1 time: 0.033837 Jul 18 08:52:38.426746 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 397/787] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:38 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 08:52:38.432816 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d9d36fed-9009-4c05-929e-4f1241e7c866 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '.version_select at 0x7fafb7062c10>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:38.546399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d9d36fed-9009-4c05-929e-4f1241e7c866 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873754792" status: 202 len: 0 microversion: 2.1 time: 0.117227 Jul 18 08:52:38.547184 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 398/788] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 08:52:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873754792 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 08:52:38.800301 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:38.973504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-dd46663d-bdb2-4aa1-a709-5875d8a9f8f6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "DELETE /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/os-volume_attachments/b824d964-9e9f-4359-90e6-eca95048fe99" status: 202 len: 0 microversion: 2.20 time: 0.994475 Jul 18 08:52:38.974128 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 391/789] 10.222.0.57 () {60 vars in 1456 bytes} [Mon Jul 18 08:52:37 2022] DELETE /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/os-volume_attachments/b824d964-9e9f-4359-90e6-eca95048fe99 => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:52:39.050606 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1de99026-9854-4790-8465-f1463e2c0ad6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:39.052203 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1de99026-9854-4790-8465-f1463e2c0ad6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:39.060816 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1de99026-9854-4790-8465-f1463e2c0ad6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:39.063975 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1de99026-9854-4790-8465-f1463e2c0ad6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:39.066637 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1de99026-9854-4790-8465-f1463e2c0ad6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:39.068208 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1de99026-9854-4790-8465-f1463e2c0ad6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:39.509665 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1de99026-9854-4790-8465-f1463e2c0ad6 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "POST /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/action" status: 202 len: 0 microversion: 2.20 time: 0.464121 Jul 18 08:52:39.513819 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 399/790] 10.222.0.57 () {62 vars in 1318 bytes} [Mon Jul 18 08:52:39 2022] POST /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:52:39.534609 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0fd267a3-627d-4685-8e82-6ee9012eec56 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:39.535805 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0fd267a3-627d-4685-8e82-6ee9012eec56 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:39.554103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0fd267a3-627d-4685-8e82-6ee9012eec56 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:39.554902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0fd267a3-627d-4685-8e82-6ee9012eec56 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:39.556276 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0fd267a3-627d-4685-8e82-6ee9012eec56 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:39.557415 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0fd267a3-627d-4685-8e82-6ee9012eec56 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:39.853230 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0fd267a3-627d-4685-8e82-6ee9012eec56 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:39.866084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0fd267a3-627d-4685-8e82-6ee9012eec56 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:39.869609 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0fd267a3-627d-4685-8e82-6ee9012eec56 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:39.871544 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0fd267a3-627d-4685-8e82-6ee9012eec56 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1674 microversion: 2.20 time: 0.355793 Jul 18 08:52:39.873174 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 392/791] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:39 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1674 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:40.894615 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b5caa2e2-63c8-480d-a946-a641c5018b02 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:40.896313 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b5caa2e2-63c8-480d-a946-a641c5018b02 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:40.925419 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b5caa2e2-63c8-480d-a946-a641c5018b02 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:40.928983 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b5caa2e2-63c8-480d-a946-a641c5018b02 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:40.930747 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b5caa2e2-63c8-480d-a946-a641c5018b02 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:40.932185 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b5caa2e2-63c8-480d-a946-a641c5018b02 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:40.993911 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-dbca190e-621a-4908-9a43-2221f6d47c57 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:40.994486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-dbca190e-621a-4908-9a43-2221f6d47c57 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:41.008593 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dbca190e-621a-4908-9a43-2221f6d47c57 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:41.009047 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dbca190e-621a-4908-9a43-2221f6d47c57 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:41.013692 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dbca190e-621a-4908-9a43-2221f6d47c57 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:41.014356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dbca190e-621a-4908-9a43-2221f6d47c57 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:41.073757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-dbca190e-621a-4908-9a43-2221f6d47c57 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/ips" status: 200 len: 150 microversion: 2.1 time: 0.083788 Jul 18 08:52:41.076541 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 393/792] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 08:52:40 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/ips => generated 150 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:52:41.392458 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b5caa2e2-63c8-480d-a946-a641c5018b02 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:41.403753 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b5caa2e2-63c8-480d-a946-a641c5018b02 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:41.405523 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b5caa2e2-63c8-480d-a946-a641c5018b02 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:41.407906 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b5caa2e2-63c8-480d-a946-a641c5018b02 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1674 microversion: 2.20 time: 0.519203 Jul 18 08:52:41.408777 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 400/793] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:40 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1674 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:42.087742 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8e0c1826-d9da-4b97-bbe4-96f9b32972fe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:42.090572 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8e0c1826-d9da-4b97-bbe4-96f9b32972fe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:42.111823 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:42.117119 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8e0c1826-d9da-4b97-bbe4-96f9b32972fe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:42.121642 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8e0c1826-d9da-4b97-bbe4-96f9b32972fe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:42.124252 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8e0c1826-d9da-4b97-bbe4-96f9b32972fe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:42.124843 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8e0c1826-d9da-4b97-bbe4-96f9b32972fe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:42.173051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-8e0c1826-d9da-4b97-bbe4-96f9b32972fe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] HTTP exception thrown: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8e0c1826-d9da-4b97-bbe4-96f9b32972fe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Request method failure captured: Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: DELETE /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 HTTP/1.1 Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3coSe05_vBCD8cZm6om8IgfnRk5zeZpdXZJGCQeHl482XmuHJbG5WZ-c8gvulc29ZQPXglG_5yOwm1YAeT7_UH0M_nOaLD0vaZHGGW3U_oayZrIdVKXmIaHe82CpJ0VV1R0ljRZo83d71n6qdyQJtzcX-8ir2dVmZiP1BA7VYOun0 Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:52:42.175155 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d7367af701b84358a4e5c5d0db473b44", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 94eed85a730b46dcb1cf694a3ebf2d3a Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:42.185235 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'fb7d6682-c259-49a3-b61d-46ac98ff9948'} Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:42.186210 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:42.187605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:42.190524 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8e0c1826-d9da-4b97-bbe4-96f9b32972fe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Returning 404 to user: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:42.190524 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8e0c1826-d9da-4b97-bbe4-96f9b32972fe tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 404 len: 111 microversion: 2.1 time: 0.093217 Jul 18 08:52:42.190524 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 394/794] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:52:42 2022] DELETE /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:52:42.191782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-53eaa2b8-9f22-4a72-be3c-ec2d41237521 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:42.192555 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-53eaa2b8-9f22-4a72-be3c-ec2d41237521 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fb7d6682-c259-49a3-b61d-46ac98ff9948] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:42.205406 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-53eaa2b8-9f22-4a72-be3c-ec2d41237521 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:42.205406 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-53eaa2b8-9f22-4a72-be3c-ec2d41237521 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:42.205630 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-53eaa2b8-9f22-4a72-be3c-ec2d41237521 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:42.206124 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-53eaa2b8-9f22-4a72-be3c-ec2d41237521 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:42.222896 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-53eaa2b8-9f22-4a72-be3c-ec2d41237521 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] HTTP exception thrown: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-53eaa2b8-9f22-4a72-be3c-ec2d41237521 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Request method failure captured: Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 HTTP/1.1 Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3coSe05_vBCD8cZm6om8IgfnRk5zeZpdXZJGCQeHl482XmuHJbG5WZ-c8gvulc29ZQPXglG_5yOwm1YAeT7_UH0M_nOaLD0vaZHGGW3U_oayZrIdVKXmIaHe82CpJ0VV1R0ljRZo83d71n6qdyQJtzcX-8ir2dVmZiP1BA7VYOun0 Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:52:42.225221 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d7367af701b84358a4e5c5d0db473b44", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 94eed85a730b46dcb1cf694a3ebf2d3a Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:42.226536 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': 'fb7d6682-c259-49a3-b61d-46ac98ff9948'} Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:42.227257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. Jul 18 08:52:42.228443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:42.229514 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-53eaa2b8-9f22-4a72-be3c-ec2d41237521 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Returning 404 to user: Instance fb7d6682-c259-49a3-b61d-46ac98ff9948 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:42.229514 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-53eaa2b8-9f22-4a72-be3c-ec2d41237521 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948" status: 404 len: 111 microversion: 2.1 time: 0.044939 Jul 18 08:52:42.229514 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 401/795] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:42 2022] GET /compute/v2.1/servers/fb7d6682-c259-49a3-b61d-46ac98ff9948 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:52:42.429747 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e32ec7e8-e841-483a-8936-4a7585add545 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:42.430180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e32ec7e8-e841-483a-8936-4a7585add545 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:42.447328 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e32ec7e8-e841-483a-8936-4a7585add545 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:42.456553 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e32ec7e8-e841-483a-8936-4a7585add545 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:42.457575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e32ec7e8-e841-483a-8936-4a7585add545 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:42.458038 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e32ec7e8-e841-483a-8936-4a7585add545 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:42.774364 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e32ec7e8-e841-483a-8936-4a7585add545 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:42.782776 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e32ec7e8-e841-483a-8936-4a7585add545 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:42.784351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e32ec7e8-e841-483a-8936-4a7585add545 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:42.785553 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e32ec7e8-e841-483a-8936-4a7585add545 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.362917 Jul 18 08:52:42.786122 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 395/796] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:42 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:43.806728 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2a8bfd8a-1a58-4fc4-9235-4d8e12edcbbd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:43.807260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-2a8bfd8a-1a58-4fc4-9235-4d8e12edcbbd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:43.815088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2a8bfd8a-1a58-4fc4-9235-4d8e12edcbbd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:43.815621 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2a8bfd8a-1a58-4fc4-9235-4d8e12edcbbd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:43.816504 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2a8bfd8a-1a58-4fc4-9235-4d8e12edcbbd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:43.817007 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2a8bfd8a-1a58-4fc4-9235-4d8e12edcbbd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:44.039547 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2a8bfd8a-1a58-4fc4-9235-4d8e12edcbbd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:44.048120 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2a8bfd8a-1a58-4fc4-9235-4d8e12edcbbd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:44.049731 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2a8bfd8a-1a58-4fc4-9235-4d8e12edcbbd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:44.050920 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2a8bfd8a-1a58-4fc4-9235-4d8e12edcbbd tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.248271 Jul 18 08:52:44.051467 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 402/797] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:43 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:45.071215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5a8d2721-d9d5-49a4-8509-dec869aada35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:45.072678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5a8d2721-d9d5-49a4-8509-dec869aada35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:45.086642 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5a8d2721-d9d5-49a4-8509-dec869aada35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:45.087230 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5a8d2721-d9d5-49a4-8509-dec869aada35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:45.088179 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5a8d2721-d9d5-49a4-8509-dec869aada35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:45.088761 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5a8d2721-d9d5-49a4-8509-dec869aada35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:45.261164 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5a8d2721-d9d5-49a4-8509-dec869aada35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:45.271690 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5a8d2721-d9d5-49a4-8509-dec869aada35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:45.273493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-5a8d2721-d9d5-49a4-8509-dec869aada35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:45.274792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5a8d2721-d9d5-49a4-8509-dec869aada35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.208404 Jul 18 08:52:45.275494 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 396/798] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:45 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:45.787935 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-51dd2508-417f-4f35-9087-1633b754bc6a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:45.788822 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-51dd2508-417f-4f35-9087-1633b754bc6a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:45.802125 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-51dd2508-417f-4f35-9087-1633b754bc6a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:45.802960 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-51dd2508-417f-4f35-9087-1633b754bc6a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:45.804819 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-51dd2508-417f-4f35-9087-1633b754bc6a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:45.805643 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-51dd2508-417f-4f35-9087-1633b754bc6a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:45.841632 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-51dd2508-417f-4f35-9087-1633b754bc6a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] HTTP exception thrown: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-51dd2508-417f-4f35-9087-1633b754bc6a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Request method failure captured: Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: DELETE /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e HTTP/1.1 Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3coSe05_vBCD8cZm6om8IgfnRk5zeZpdXZJGCQeHl482XmuHJbG5WZ-c8gvulc29ZQPXglG_5yOwm1YAeT7_UH0M_nOaLD0vaZHGGW3U_oayZrIdVKXmIaHe82CpJ0VV1R0ljRZo83d71n6qdyQJtzcX-8ir2dVmZiP1BA7VYOun0 Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:52:45.847249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d7367af701b84358a4e5c5d0db473b44", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 94eed85a730b46dcb1cf694a3ebf2d3a Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:52:45.850352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': 'fcda6e64-2c95-4eb7-bff6-6e13f99e254e'} Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:45.851977 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:52:45.856672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:45.865820 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-51dd2508-417f-4f35-9087-1633b754bc6a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Returning 404 to user: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:45.865820 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-51dd2508-417f-4f35-9087-1633b754bc6a tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 404 len: 111 microversion: 2.1 time: 0.082726 Jul 18 08:52:45.873256 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 403/799] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:52:45 2022] DELETE /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:52:45.883509 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ea6ca0ba-0dcc-43c4-9bd6-3f0c5abb50b2 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:45.886436 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ea6ca0ba-0dcc-43c4-9bd6-3f0c5abb50b2 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] [instance: fcda6e64-2c95-4eb7-bff6-6e13f99e254e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:45.905779 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ea6ca0ba-0dcc-43c4-9bd6-3f0c5abb50b2 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:45.907616 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ea6ca0ba-0dcc-43c4-9bd6-3f0c5abb50b2 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:45.909469 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ea6ca0ba-0dcc-43c4-9bd6-3f0c5abb50b2 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:45.910382 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ea6ca0ba-0dcc-43c4-9bd6-3f0c5abb50b2 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:45.942622 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-ea6ca0ba-0dcc-43c4-9bd6-3f0c5abb50b2 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] HTTP exception thrown: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ea6ca0ba-0dcc-43c4-9bd6-3f0c5abb50b2 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Request method failure captured: Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e HTTP/1.1 Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3coSe05_vBCD8cZm6om8IgfnRk5zeZpdXZJGCQeHl482XmuHJbG5WZ-c8gvulc29ZQPXglG_5yOwm1YAeT7_UH0M_nOaLD0vaZHGGW3U_oayZrIdVKXmIaHe82CpJ0VV1R0ljRZo83d71n6qdyQJtzcX-8ir2dVmZiP1BA7VYOun0 Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:52:45.955554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d7367af701b84358a4e5c5d0db473b44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d7367af701b84358a4e5c5d0db473b44", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: d7367af701b84358a4e5c5d0db473b44 Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeTestJSON-807735826 Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 94eed85a730b46dcb1cf694a3ebf2d3a Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeTestJSON-807735826-project Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:52:45.957416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'fcda6e64-2c95-4eb7-bff6-6e13f99e254e'} Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:45.958342 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. Jul 18 08:52:45.960303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:45.961736 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ea6ca0ba-0dcc-43c4-9bd6-3f0c5abb50b2 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] Returning 404 to user: Instance fcda6e64-2c95-4eb7-bff6-6e13f99e254e could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:45.961736 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ea6ca0ba-0dcc-43c4-9bd6-3f0c5abb50b2 tempest-AttachVolumeTestJSON-807735826 tempest-AttachVolumeTestJSON-807735826-project] 10.222.0.57 "GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e" status: 404 len: 111 microversion: 2.1 time: 0.074018 Jul 18 08:52:45.961736 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 397/800] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:45 2022] GET /compute/v2.1/servers/fcda6e64-2c95-4eb7-bff6-6e13f99e254e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:52:46.293713 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c8af384b-3a7d-4643-88bc-2d208534cddb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:46.294327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c8af384b-3a7d-4643-88bc-2d208534cddb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:46.301285 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8af384b-3a7d-4643-88bc-2d208534cddb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:46.301739 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8af384b-3a7d-4643-88bc-2d208534cddb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:46.308723 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8af384b-3a7d-4643-88bc-2d208534cddb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:46.308723 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8af384b-3a7d-4643-88bc-2d208534cddb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:46.446945 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-02fb5429-368e-49a8-9bb1-ab7b8d4e8658 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ef05729-0fa3-4372-b8a4-a2b5c7492f9b"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:46.448741 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-02fb5429-368e-49a8-9bb1-ab7b8d4e8658 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:46.467094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-02fb5429-368e-49a8-9bb1-ab7b8d4e8658 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:46.467809 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-02fb5429-368e-49a8-9bb1-ab7b8d4e8658 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:46.468816 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-02fb5429-368e-49a8-9bb1-ab7b8d4e8658 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:46.470516 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-02fb5429-368e-49a8-9bb1-ab7b8d4e8658 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:46.617938 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c8af384b-3a7d-4643-88bc-2d208534cddb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:46.635018 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c8af384b-3a7d-4643-88bc-2d208534cddb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:46.636998 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c8af384b-3a7d-4643-88bc-2d208534cddb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:46.642227 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c8af384b-3a7d-4643-88bc-2d208534cddb tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.352036 Jul 18 08:52:46.644205 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 404/801] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:46 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:47.558856 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-02fb5429-368e-49a8-9bb1-ab7b8d4e8658 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "POST /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.116936 Jul 18 08:52:47.586860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 398/802] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:52:46 2022] POST /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-volume_attachments => generated 194 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:52:47.670545 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-76ed0e7e-47aa-4618-a32a-98c339d63561 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:47.674843 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-76ed0e7e-47aa-4618-a32a-98c339d63561 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:47.747477 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76ed0e7e-47aa-4618-a32a-98c339d63561 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:47.750384 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76ed0e7e-47aa-4618-a32a-98c339d63561 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:47.761817 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76ed0e7e-47aa-4618-a32a-98c339d63561 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:47.771382 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-76ed0e7e-47aa-4618-a32a-98c339d63561 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:48.350702 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-76ed0e7e-47aa-4618-a32a-98c339d63561 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:48.362946 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-76ed0e7e-47aa-4618-a32a-98c339d63561 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:48.367023 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-76ed0e7e-47aa-4618-a32a-98c339d63561 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:48.370020 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-76ed0e7e-47aa-4618-a32a-98c339d63561 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.711256 Jul 18 08:52:48.384311 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 405/803] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:47 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:52:49.393703 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7eef9c5e-42ef-42ff-8235-66e4cc959aec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:49.395144 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7eef9c5e-42ef-42ff-8235-66e4cc959aec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:49.409589 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7eef9c5e-42ef-42ff-8235-66e4cc959aec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:49.413461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7eef9c5e-42ef-42ff-8235-66e4cc959aec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:49.414584 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7eef9c5e-42ef-42ff-8235-66e4cc959aec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:49.416203 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7eef9c5e-42ef-42ff-8235-66e4cc959aec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:49.721156 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7eef9c5e-42ef-42ff-8235-66e4cc959aec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:49.731484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7eef9c5e-42ef-42ff-8235-66e4cc959aec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:49.733962 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7eef9c5e-42ef-42ff-8235-66e4cc959aec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:49.736513 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7eef9c5e-42ef-42ff-8235-66e4cc959aec tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.348145 Jul 18 08:52:49.737427 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 399/804] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:49 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:49.978676 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-449d49da-67cd-4b92-9143-9be1cfe388d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:49.981624 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-449d49da-67cd-4b92-9143-9be1cfe388d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:50.001950 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-449d49da-67cd-4b92-9143-9be1cfe388d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:50.002454 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-449d49da-67cd-4b92-9143-9be1cfe388d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:50.003341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-449d49da-67cd-4b92-9143-9be1cfe388d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:50.003862 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-449d49da-67cd-4b92-9143-9be1cfe388d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:50.094940 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-449d49da-67cd-4b92-9143-9be1cfe388d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:52:50.671629 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-449d49da-67cd-4b92-9143-9be1cfe388d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 204 len: 0 microversion: 2.1 time: 0.700725 Jul 18 08:52:50.674782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 406/805] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:52:49 2022] DELETE /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 0 bytes in 706 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:52:50.693363 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-fda97a82-f1b0-455d-a2d1-9efad8905158 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:50.694490 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-fda97a82-f1b0-455d-a2d1-9efad8905158 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:50.718818 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fda97a82-f1b0-455d-a2d1-9efad8905158 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:50.720322 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fda97a82-f1b0-455d-a2d1-9efad8905158 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:50.721186 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fda97a82-f1b0-455d-a2d1-9efad8905158 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:50.721641 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-fda97a82-f1b0-455d-a2d1-9efad8905158 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:50.758721 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9499c176-4685-4a4e-b770-a268d7bc78c4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:50.760388 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9499c176-4685-4a4e-b770-a268d7bc78c4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:50.779546 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9499c176-4685-4a4e-b770-a268d7bc78c4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:50.781095 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9499c176-4685-4a4e-b770-a268d7bc78c4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:50.783363 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9499c176-4685-4a4e-b770-a268d7bc78c4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:50.787529 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9499c176-4685-4a4e-b770-a268d7bc78c4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:51.006255 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-fda97a82-f1b0-455d-a2d1-9efad8905158 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:51.014747 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-fda97a82-f1b0-455d-a2d1-9efad8905158 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1577 microversion: 2.1 time: 0.332078 Jul 18 08:52:51.035150 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 400/806] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:50 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1577 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:51.058276 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9499c176-4685-4a4e-b770-a268d7bc78c4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:51.067599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9499c176-4685-4a4e-b770-a268d7bc78c4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:51.069482 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9499c176-4685-4a4e-b770-a268d7bc78c4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:51.070972 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9499c176-4685-4a4e-b770-a268d7bc78c4 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.318301 Jul 18 08:52:51.072105 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 407/807] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:50 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:52.052367 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8116c078-2c37-4faa-afdb-136d7b2f8dca tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:52.053045 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8116c078-2c37-4faa-afdb-136d7b2f8dca tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:52.060228 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8116c078-2c37-4faa-afdb-136d7b2f8dca tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:52.063438 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8116c078-2c37-4faa-afdb-136d7b2f8dca tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:52.063438 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8116c078-2c37-4faa-afdb-136d7b2f8dca tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:52.063438 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8116c078-2c37-4faa-afdb-136d7b2f8dca tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:52.091184 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-39dba907-a9ef-4a4e-99c3-f55e3e18ae21 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:52.092498 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-39dba907-a9ef-4a4e-99c3-f55e3e18ae21 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:52.106530 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39dba907-a9ef-4a4e-99c3-f55e3e18ae21 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:52.107365 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39dba907-a9ef-4a4e-99c3-f55e3e18ae21 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:52.108529 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39dba907-a9ef-4a4e-99c3-f55e3e18ae21 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:52.109061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-39dba907-a9ef-4a4e-99c3-f55e3e18ae21 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:52.316637 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-8116c078-2c37-4faa-afdb-136d7b2f8dca tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:52.326209 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8116c078-2c37-4faa-afdb-136d7b2f8dca tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1577 microversion: 2.1 time: 0.277473 Jul 18 08:52:52.327090 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 401/808] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:52 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1577 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:52.393797 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-39dba907-a9ef-4a4e-99c3-f55e3e18ae21 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:52.402722 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-39dba907-a9ef-4a4e-99c3-f55e3e18ae21 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:52.405261 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-39dba907-a9ef-4a4e-99c3-f55e3e18ae21 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:52.408129 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-39dba907-a9ef-4a4e-99c3-f55e3e18ae21 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.320193 Jul 18 08:52:52.409369 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 408/809] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:52 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:52:53.345814 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-be10fd4e-92ed-4179-8729-e0e8a237276b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:53.347044 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-be10fd4e-92ed-4179-8729-e0e8a237276b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:53.359641 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be10fd4e-92ed-4179-8729-e0e8a237276b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:53.359641 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be10fd4e-92ed-4179-8729-e0e8a237276b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:53.359641 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be10fd4e-92ed-4179-8729-e0e8a237276b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:53.365670 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-be10fd4e-92ed-4179-8729-e0e8a237276b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:53.427219 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9c605f5e-9204-4078-b08f-7a99a1ee7ca0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:53.428714 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9c605f5e-9204-4078-b08f-7a99a1ee7ca0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:53.443594 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9c605f5e-9204-4078-b08f-7a99a1ee7ca0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:53.444479 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9c605f5e-9204-4078-b08f-7a99a1ee7ca0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:53.447124 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9c605f5e-9204-4078-b08f-7a99a1ee7ca0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:53.448837 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9c605f5e-9204-4078-b08f-7a99a1ee7ca0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:53.754249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9c605f5e-9204-4078-b08f-7a99a1ee7ca0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:53.756257 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-be10fd4e-92ed-4179-8729-e0e8a237276b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:53.765162 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-be10fd4e-92ed-4179-8729-e0e8a237276b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1577 microversion: 2.1 time: 0.424884 Jul 18 08:52:53.766268 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 402/810] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:53 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1577 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:53.768417 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9c605f5e-9204-4078-b08f-7a99a1ee7ca0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:53.770957 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9c605f5e-9204-4078-b08f-7a99a1ee7ca0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:53.775101 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9c605f5e-9204-4078-b08f-7a99a1ee7ca0 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.350291 Jul 18 08:52:53.777585 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 409/811] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:53 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:54.783175 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a487002c-1308-4776-90d8-0ed7976fba6a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:54.784211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a487002c-1308-4776-90d8-0ed7976fba6a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:54.793723 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bb81313d-ea59-44f6-abc9-8916750fb90b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:54.794638 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bb81313d-ea59-44f6-abc9-8916750fb90b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:54.798682 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a487002c-1308-4776-90d8-0ed7976fba6a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:54.799651 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a487002c-1308-4776-90d8-0ed7976fba6a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:54.800630 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a487002c-1308-4776-90d8-0ed7976fba6a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:54.801423 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a487002c-1308-4776-90d8-0ed7976fba6a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:54.802672 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:54.809923 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bb81313d-ea59-44f6-abc9-8916750fb90b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:54.813402 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bb81313d-ea59-44f6-abc9-8916750fb90b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:54.814549 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bb81313d-ea59-44f6-abc9-8916750fb90b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:54.815009 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bb81313d-ea59-44f6-abc9-8916750fb90b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:55.069640 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bb81313d-ea59-44f6-abc9-8916750fb90b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:55.084243 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bb81313d-ea59-44f6-abc9-8916750fb90b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:55.084385 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a487002c-1308-4776-90d8-0ed7976fba6a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:55.085392 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bb81313d-ea59-44f6-abc9-8916750fb90b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:55.086881 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bb81313d-ea59-44f6-abc9-8916750fb90b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.297324 Jul 18 08:52:55.088206 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 410/812] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:54 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:55.100803 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a487002c-1308-4776-90d8-0ed7976fba6a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1577 microversion: 2.1 time: 0.320392 Jul 18 08:52:55.104921 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 403/813] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:54 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1577 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:55.345590 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-0c61c61b-d25f-49f1-b451-d5155ef50154 req-71750f4e-6958-49f5-9b46-e32c94e7241b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c53c5dca-7e2b-4a47-9a81-7888b20e67fe", "name": "network-vif-unplugged", "status": "completed", "tag": "31760e24-104d-4678-9e4f-2ba58cdc21a9"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:55.369023 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-0c61c61b-d25f-49f1-b451-d5155ef50154 req-71750f4e-6958-49f5-9b46-e32c94e7241b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:55.369768 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-0c61c61b-d25f-49f1-b451-d5155ef50154 req-71750f4e-6958-49f5-9b46-e32c94e7241b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:55.385335 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-0c61c61b-d25f-49f1-b451-d5155ef50154 req-71750f4e-6958-49f5-9b46-e32c94e7241b service nova] Creating event network-vif-unplugged:31760e24-104d-4678-9e4f-2ba58cdc21a9 for instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe on hv-cinder-85014 Jul 18 08:52:55.392064 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-0c61c61b-d25f-49f1-b451-d5155ef50154 req-71750f4e-6958-49f5-9b46-e32c94e7241b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051658 Jul 18 08:52:55.393411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 411/814] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:52:55.987047 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-355a7031-f5b9-4c61-8d23-5ef60008e078 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Action: 'create', calling method: .version_select at 0x7fafb7166940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1705906061", "metadata": {"Type": "work"}}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-355a7031-f5b9-4c61-8d23-5ef60008e078 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Request method failure captured: Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 122 Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R9nJsL4_ugzuHcLpzLRZcvhL2wzitjXU95TuloJj-vLbMMCCMZ9TZntU2YmM0GPX-4CREUXA2e0esUnCRehKTaoHdM_VyKZcC0c4ujOfVRyyhZ_uNR83HFzVF2i9I10Cjv2AiP4Azy2qiQEpS7IxkXwRl68AtGbSx0414HBSmMSoM0 Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:52:56.018720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a863f588132743b59342ec6931aabf0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a863f588132743b59342ec6931aabf0b", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: fb32461d7cdc4aaf8f1749d03b4ae89e Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1705906061", "metadata": {"Type": "work"}}} Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: Jul 18 08:52:56.021792 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1705906061', 'metadata': {'Type': 'work'}}}} Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise error Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:56.023204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 08:52:56.031169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 08:52:56.034644 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 08:52:56.034644 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.034644 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-355a7031-f5b9-4c61-8d23-5ef60008e078 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:56.034644 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-355a7031-f5b9-4c61-8d23-5ef60008e078 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.491277 Jul 18 08:52:56.034644 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 404/815] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Jul 18 08:52:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 493 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8e4aa054-45a4-43a7-8c55-37902c5483f3 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Action: 'create', calling method: .version_select at 0x7fafb7070160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1236064448", "metadata": {"Type": "work"}}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8e4aa054-45a4-43a7-8c55-37902c5483f3 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Request method failure captured: Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 120 Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R9nJsL4_ugzuHcLpzLRZcvhL2wzitjXU95TuloJj-vLbMMCCMZ9TZntU2YmM0GPX-4CREUXA2e0esUnCRehKTaoHdM_VyKZcC0c4ujOfVRyyhZ_uNR83HFzVF2i9I10Cjv2AiP4Azy2qiQEpS7IxkXwRl68AtGbSx0414HBSmMSoM0 Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:52:56.045970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a863f588132743b59342ec6931aabf0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a863f588132743b59342ec6931aabf0b", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: fb32461d7cdc4aaf8f1749d03b4ae89e Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1236064448", "metadata": {"Type": "work"}}} Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: Jul 18 08:52:56.050183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1236064448', 'metadata': {'Type': 'work'}}}} Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise error Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi '0' Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:56.052013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 08:52:56.054524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 08:52:56.061580 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 08:52:56.061580 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.061580 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8e4aa054-45a4-43a7-8c55-37902c5483f3 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:56.061580 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8e4aa054-45a4-43a7-8c55-37902c5483f3 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016896 Jul 18 08:52:56.061580 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 412/816] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Jul 18 08:52:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 08:52:56.071419 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8ced1133-c537-49ef-9b20-7ee24038d425 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Action: 'create', calling method: .version_select at 0x7fafb7106040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2101723212", "metadata": {"Type": "work"}}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8ced1133-c537-49ef-9b20-7ee24038d425 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Request method failure captured: Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 119 Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R9nJsL4_ugzuHcLpzLRZcvhL2wzitjXU95TuloJj-vLbMMCCMZ9TZntU2YmM0GPX-4CREUXA2e0esUnCRehKTaoHdM_VyKZcC0c4ujOfVRyyhZ_uNR83HFzVF2i9I10Cjv2AiP4Azy2qiQEpS7IxkXwRl68AtGbSx0414HBSmMSoM0 Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:52:56.074193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a863f588132743b59342ec6931aabf0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a863f588132743b59342ec6931aabf0b", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: fb32461d7cdc4aaf8f1749d03b4ae89e Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2101723212", "metadata": {"Type": "work"}}} Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: Jul 18 08:52:56.078939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2101723212', 'metadata': {'Type': 'work'}}}} Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise error Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi '' Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:56.081771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 08:52:56.085196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 08:52:56.088973 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 08:52:56.088973 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.088973 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8ced1133-c537-49ef-9b20-7ee24038d425 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:56.088973 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8ced1133-c537-49ef-9b20-7ee24038d425 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009163 Jul 18 08:52:56.088973 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 405/817] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Jul 18 08:52:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 08:52:56.102949 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0925df75-4326-432c-ae7f-25b99ad597d5 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Calling method '.version_select at 0x7fafb7071670>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:56.119403 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ead7f3f6-b0c8-48f8-b7bd-f538f90db0f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:56.120028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ead7f3f6-b0c8-48f8-b7bd-f538f90db0f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:56.127307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ead7f3f6-b0c8-48f8-b7bd-f538f90db0f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:56.127961 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ead7f3f6-b0c8-48f8-b7bd-f538f90db0f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:56.128816 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ead7f3f6-b0c8-48f8-b7bd-f538f90db0f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:56.129264 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ead7f3f6-b0c8-48f8-b7bd-f538f90db0f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:56.183899 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-0925df75-4326-432c-ae7f-25b99ad597d5 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] HTTP exception thrown: Volume tempest-invalid-1034063065 could not be found. Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0925df75-4326-432c-ae7f-25b99ad597d5 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Request method failure captured: Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1034063065 HTTP/1.1 Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R9nJsL4_ugzuHcLpzLRZcvhL2wzitjXU95TuloJj-vLbMMCCMZ9TZntU2YmM0GPX-4CREUXA2e0esUnCRehKTaoHdM_VyKZcC0c4ujOfVRyyhZ_uNR83HFzVF2i9I10Cjv2AiP4Azy2qiQEpS7IxkXwRl68AtGbSx0414HBSmMSoM0 Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:52:56.195341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a863f588132743b59342ec6931aabf0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a863f588132743b59342ec6931aabf0b", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: fb32461d7cdc4aaf8f1749d03b4ae89e Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Volume tempest-invalid-1034063065 could not be found. Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': 'tempest-invalid-1034063065'} Jul 18 08:52:56.204122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1034063065 could not be found. (HTTP 404) (Request-ID: req-9f075038-7b72-4138-ba35-0529c3e3ff4a) Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.205344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 08:52:56.207133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1034063065 could not be found. Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:52:56.210485 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1034063065 could not be found. Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1034063065 could not be found. Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0925df75-4326-432c-ae7f-25b99ad597d5 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Returning 404 to user: Volume tempest-invalid-1034063065 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0925df75-4326-432c-ae7f-25b99ad597d5 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1034063065" status: 404 len: 99 microversion: 2.1 time: 0.103348 Jul 18 08:52:56.214211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 413/818] 10.222.0.57 () {58 vars in 1217 bytes} [Mon Jul 18 08:52:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1034063065 => generated 99 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 08:52:56.215364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e4346726-0589-4363-9166-9bff21c3348b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:56.215364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e4346726-0589-4363-9166-9bff21c3348b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:56.215364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4346726-0589-4363-9166-9bff21c3348b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:56.215364 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4346726-0589-4363-9166-9bff21c3348b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:56.215826 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4346726-0589-4363-9166-9bff21c3348b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:56.215826 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e4346726-0589-4363-9166-9bff21c3348b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:56.396956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ead7f3f6-b0c8-48f8-b7bd-f538f90db0f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:56.422036 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ead7f3f6-b0c8-48f8-b7bd-f538f90db0f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:56.429489 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-ead7f3f6-b0c8-48f8-b7bd-f538f90db0f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:56.431513 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ead7f3f6-b0c8-48f8-b7bd-f538f90db0f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.315754 Jul 18 08:52:56.432115 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 406/819] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:56 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 08:52:56.439793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-19cbdb89-7dc6-40ea-a0cc-13a56fe88448 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006376 Jul 18 08:52:56.440883 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 407/820] 10.222.0.57 () {58 vars in 1139 bytes} [Mon Jul 18 08:52:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 08:52:56.462477 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d4c251cf-99e2-4455-acac-0fb24d004023 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004474 Jul 18 08:52:56.463558 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 408/821] 10.222.0.57 () {58 vars in 1136 bytes} [Mon Jul 18 08:52:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 08:52:56.473011 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e4346726-0589-4363-9166-9bff21c3348b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:56.475998 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-886a69e8-b433-43a5-bee0-9860b2ec82a2 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Calling method '.version_select at 0x7fafb7112670>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:56.482795 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e4346726-0589-4363-9166-9bff21c3348b tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1577 microversion: 2.1 time: 0.291886 Jul 18 08:52:56.483345 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 414/822] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:56 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1577 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:52:56.527518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-886a69e8-b433-43a5-bee0-9860b2ec82a2 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] HTTP exception thrown: Volume f09b836b-63c6-4f18-b972-66d0ecfd3a7d could not be found. Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-886a69e8-b433-43a5-bee0-9860b2ec82a2 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Request method failure captured: Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: DELETE /compute/v2.1/os-volumes/f09b836b-63c6-4f18-b972-66d0ecfd3a7d HTTP/1.1 Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R9nJsL4_ugzuHcLpzLRZcvhL2wzitjXU95TuloJj-vLbMMCCMZ9TZntU2YmM0GPX-4CREUXA2e0esUnCRehKTaoHdM_VyKZcC0c4ujOfVRyyhZ_uNR83HFzVF2i9I10Cjv2AiP4Azy2qiQEpS7IxkXwRl68AtGbSx0414HBSmMSoM0 Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:52:56.533034 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a863f588132743b59342ec6931aabf0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a863f588132743b59342ec6931aabf0b", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: fb32461d7cdc4aaf8f1749d03b4ae89e Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Volume f09b836b-63c6-4f18-b972-66d0ecfd3a7d could not be found. Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'f09b836b-63c6-4f18-b972-66d0ecfd3a7d'} Jul 18 08:52:56.534518 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f09b836b-63c6-4f18-b972-66d0ecfd3a7d could not be found. (HTTP 404) (Request-ID: req-1c6f4baf-307e-43dd-b603-d6471fc7aa90) Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.535374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 08:52:56.536770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f09b836b-63c6-4f18-b972-66d0ecfd3a7d could not be found. Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 08:52:56.538307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f09b836b-63c6-4f18-b972-66d0ecfd3a7d could not be found. Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f09b836b-63c6-4f18-b972-66d0ecfd3a7d could not be found. Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-886a69e8-b433-43a5-bee0-9860b2ec82a2 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Returning 404 to user: Volume f09b836b-63c6-4f18-b972-66d0ecfd3a7d could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:56.539897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-886a69e8-b433-43a5-bee0-9860b2ec82a2 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/f09b836b-63c6-4f18-b972-66d0ecfd3a7d" status: 404 len: 109 microversion: 2.1 time: 0.064612 Jul 18 08:52:56.545820 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 409/823] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 08:52:56 2022] DELETE /compute/v2.1/os-volumes/f09b836b-63c6-4f18-b972-66d0ecfd3a7d => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:52:56.551715 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-baefd27d-3196-4435-8759-bd8923d2b945 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Calling method '.version_select at 0x7fafb7071160>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:56.603845 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-baefd27d-3196-4435-8759-bd8923d2b945 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] HTTP exception thrown: Volume a0f6fa9c-2cc4-40f9-afc8-a8003cbbc196 could not be found. Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-baefd27d-3196-4435-8759-bd8923d2b945 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Request method failure captured: Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/os-volumes/a0f6fa9c-2cc4-40f9-afc8-a8003cbbc196 HTTP/1.1 Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R9nJsL4_ugzuHcLpzLRZcvhL2wzitjXU95TuloJj-vLbMMCCMZ9TZntU2YmM0GPX-4CREUXA2e0esUnCRehKTaoHdM_VyKZcC0c4ujOfVRyyhZ_uNR83HFzVF2i9I10Cjv2AiP4Azy2qiQEpS7IxkXwRl68AtGbSx0414HBSmMSoM0 Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:52:56.611499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/a863f588132743b59342ec6931aabf0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/a863f588132743b59342ec6931aabf0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_a863f588132743b59342ec6931aabf0b", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: a863f588132743b59342ec6931aabf0b Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-VolumesNegativeTest-1219759133 Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: fb32461d7cdc4aaf8f1749d03b4ae89e Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-VolumesNegativeTest-1219759133-project Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Volume a0f6fa9c-2cc4-40f9-afc8-a8003cbbc196 could not be found. Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': 'a0f6fa9c-2cc4-40f9-afc8-a8003cbbc196'} Jul 18 08:52:56.613117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0f6fa9c-2cc4-40f9-afc8-a8003cbbc196 could not be found. (HTTP 404) (Request-ID: req-9ba4df78-0258-42ff-b6c0-cbbfa1e8fef8) Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.614046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 08:52:56.615381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0f6fa9c-2cc4-40f9-afc8-a8003cbbc196 could not be found. Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 08:52:56.616796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0f6fa9c-2cc4-40f9-afc8-a8003cbbc196 could not be found. Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0f6fa9c-2cc4-40f9-afc8-a8003cbbc196 could not be found. Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:52:56.619069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-baefd27d-3196-4435-8759-bd8923d2b945 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] Returning 404 to user: Volume a0f6fa9c-2cc4-40f9-afc8-a8003cbbc196 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:52:56.624864 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-baefd27d-3196-4435-8759-bd8923d2b945 tempest-VolumesNegativeTest-1219759133 tempest-VolumesNegativeTest-1219759133-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a0f6fa9c-2cc4-40f9-afc8-a8003cbbc196" status: 404 len: 109 microversion: 2.1 time: 0.072840 Jul 18 08:52:56.626253 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 415/824] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:52:56 2022] GET /compute/v2.1/os-volumes/a0f6fa9c-2cc4-40f9-afc8-a8003cbbc196 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 08:52:57.466204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3f5af447-2225-4238-b136-9b8f04ccbdf7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:57.467468 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3f5af447-2225-4238-b136-9b8f04ccbdf7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:57.484070 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3f5af447-2225-4238-b136-9b8f04ccbdf7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:57.485411 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3f5af447-2225-4238-b136-9b8f04ccbdf7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:57.486291 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3f5af447-2225-4238-b136-9b8f04ccbdf7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:57.486890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3f5af447-2225-4238-b136-9b8f04ccbdf7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:57.509309 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-52f21065-47eb-4e10-8af6-a70ef33ce0d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:57.513798 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-52f21065-47eb-4e10-8af6-a70ef33ce0d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:57.544516 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-52f21065-47eb-4e10-8af6-a70ef33ce0d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:57.544990 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-52f21065-47eb-4e10-8af6-a70ef33ce0d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:57.545858 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-52f21065-47eb-4e10-8af6-a70ef33ce0d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:57.546286 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-52f21065-47eb-4e10-8af6-a70ef33ce0d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:57.881812 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3f5af447-2225-4238-b136-9b8f04ccbdf7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:57.925379 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3f5af447-2225-4238-b136-9b8f04ccbdf7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:57.928832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3f5af447-2225-4238-b136-9b8f04ccbdf7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:57.934724 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3f5af447-2225-4238-b136-9b8f04ccbdf7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.470747 Jul 18 08:52:57.938615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 410/825] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:57 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:58.082546 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-52f21065-47eb-4e10-8af6-a70ef33ce0d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:58.091387 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-52f21065-47eb-4e10-8af6-a70ef33ce0d1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1577 microversion: 2.1 time: 0.586903 Jul 18 08:52:58.092019 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 416/826] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:57 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1577 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:52:58.959882 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f519fb35-f798-40bd-886a-61df2aa682f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:58.962374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f519fb35-f798-40bd-886a-61df2aa682f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:58.967035 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f519fb35-f798-40bd-886a-61df2aa682f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:58.967616 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f519fb35-f798-40bd-886a-61df2aa682f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:58.968607 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f519fb35-f798-40bd-886a-61df2aa682f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:58.969596 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f519fb35-f798-40bd-886a-61df2aa682f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:59.114047 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f9346de3-fc22-4d63-b565-22248d67fb43 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:52:59.114777 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f9346de3-fc22-4d63-b565-22248d67fb43 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:52:59.123071 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f9346de3-fc22-4d63-b565-22248d67fb43 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:59.123632 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f9346de3-fc22-4d63-b565-22248d67fb43 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:59.129433 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f9346de3-fc22-4d63-b565-22248d67fb43 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:52:59.129433 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f9346de3-fc22-4d63-b565-22248d67fb43 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:52:59.149062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f519fb35-f798-40bd-886a-61df2aa682f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:59.159446 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f519fb35-f798-40bd-886a-61df2aa682f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:59.163157 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f519fb35-f798-40bd-886a-61df2aa682f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:59.163157 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f519fb35-f798-40bd-886a-61df2aa682f7 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.207613 Jul 18 08:52:59.164266 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 411/827] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:52:58 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:52:59.172935 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:52:59.332497 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f9346de3-fc22-4d63-b565-22248d67fb43 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:52:59.340250 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f9346de3-fc22-4d63-b565-22248d67fb43 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1577 microversion: 2.1 time: 0.235103 Jul 18 08:52:59.340841 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 417/828] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:52:59 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1577 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:53:00.188483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-88832dfc-211b-46c4-9cd9-29d2bbcd126f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:00.189771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-88832dfc-211b-46c4-9cd9-29d2bbcd126f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:00.198529 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-88832dfc-211b-46c4-9cd9-29d2bbcd126f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:00.199586 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-88832dfc-211b-46c4-9cd9-29d2bbcd126f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:00.200623 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-88832dfc-211b-46c4-9cd9-29d2bbcd126f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:00.201069 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-88832dfc-211b-46c4-9cd9-29d2bbcd126f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:00.250300 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-941c8d16-8714-4695-ae38-848f40202b66 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:00.252945 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-941c8d16-8714-4695-ae38-848f40202b66 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:00.266554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-941c8d16-8714-4695-ae38-848f40202b66 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:00.266554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-941c8d16-8714-4695-ae38-848f40202b66 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:00.268098 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-941c8d16-8714-4695-ae38-848f40202b66 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:00.268820 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-941c8d16-8714-4695-ae38-848f40202b66 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:00.373900 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-941c8d16-8714-4695-ae38-848f40202b66 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lazy-loading 'services' on Instance uuid ab98b057-4071-4710-8fd9-d6d98cc8f159 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:53:00.445865 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-88832dfc-211b-46c4-9cd9-29d2bbcd126f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:00.461375 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-88832dfc-211b-46c4-9cd9-29d2bbcd126f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:00.463929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-88832dfc-211b-46c4-9cd9-29d2bbcd126f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:00.466503 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-88832dfc-211b-46c4-9cd9-29d2bbcd126f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.282506 Jul 18 08:53:00.467265 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 412/829] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:00 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:00.485452 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-bab5fe86-377f-48c3-949e-7e2934ec5895 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:00.485452 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-bab5fe86-377f-48c3-949e-7e2934ec5895 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:00.485452 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bab5fe86-377f-48c3-949e-7e2934ec5895 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:00.485452 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bab5fe86-377f-48c3-949e-7e2934ec5895 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:00.485945 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bab5fe86-377f-48c3-949e-7e2934ec5895 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:00.485945 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bab5fe86-377f-48c3-949e-7e2934ec5895 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:00.509838 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:00.563636 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-bab5fe86-377f-48c3-949e-7e2934ec5895 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:00.572278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-bab5fe86-377f-48c3-949e-7e2934ec5895 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1509 microversion: 2.1 time: 0.103893 Jul 18 08:53:00.573010 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 413/830] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:00 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1509 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:00.713843 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-941c8d16-8714-4695-ae38-848f40202b66 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-volume_attachments/1ef05729-0fa3-4372-b8a4-a2b5c7492f9b" status: 202 len: 0 microversion: 2.1 time: 0.472222 Jul 18 08:53:00.714442 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 418/831] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:53:00 2022] DELETE /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-volume_attachments/1ef05729-0fa3-4372-b8a4-a2b5c7492f9b => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:53:00.732861 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-281b732c-078b-48e5-9478-6cdeb859e839 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:00.734060 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-281b732c-078b-48e5-9478-6cdeb859e839 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:00.741099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-281b732c-078b-48e5-9478-6cdeb859e839 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:00.746426 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-281b732c-078b-48e5-9478-6cdeb859e839 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:00.746426 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-281b732c-078b-48e5-9478-6cdeb859e839 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:00.746426 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-281b732c-078b-48e5-9478-6cdeb859e839 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:00.776260 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-281b732c-078b-48e5-9478-6cdeb859e839 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053742 Jul 18 08:53:00.776858 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 414/832] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:53:00 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:53:00.987980 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-68a0b779-0dc5-48e6-b573-56fb7d6d7d61 req-107a4a3d-341c-4a92-8fdd-c9ee4cb7e2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c53c5dca-7e2b-4a47-9a81-7888b20e67fe", "name": "network-vif-deleted", "tag": "31760e24-104d-4678-9e4f-2ba58cdc21a9"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:53:01.007535 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-68a0b779-0dc5-48e6-b573-56fb7d6d7d61 req-107a4a3d-341c-4a92-8fdd-c9ee4cb7e2ae service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:01.008204 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-68a0b779-0dc5-48e6-b573-56fb7d6d7d61 req-107a4a3d-341c-4a92-8fdd-c9ee4cb7e2ae service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:01.026379 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-68a0b779-0dc5-48e6-b573-56fb7d6d7d61 req-107a4a3d-341c-4a92-8fdd-c9ee4cb7e2ae service nova] Creating event network-vif-deleted:31760e24-104d-4678-9e4f-2ba58cdc21a9 for instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe on hv-cinder-85014 Jul 18 08:53:01.034451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-68a0b779-0dc5-48e6-b573-56fb7d6d7d61 req-107a4a3d-341c-4a92-8fdd-c9ee4cb7e2ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062908 Jul 18 08:53:01.035609 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 419/833] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:53:01.493570 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-24098e9b-7a09-4163-a4b1-a7e2088de6af tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:01.494255 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-24098e9b-7a09-4163-a4b1-a7e2088de6af tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:01.504897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-24098e9b-7a09-4163-a4b1-a7e2088de6af tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:01.506234 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-24098e9b-7a09-4163-a4b1-a7e2088de6af tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:01.507129 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-24098e9b-7a09-4163-a4b1-a7e2088de6af tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:01.508198 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-24098e9b-7a09-4163-a4b1-a7e2088de6af tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:01.595300 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-24b4488b-2110-42eb-a313-5cc720dac7c1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:01.596228 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-24b4488b-2110-42eb-a313-5cc720dac7c1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:01.615091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-24b4488b-2110-42eb-a313-5cc720dac7c1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:01.615091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-24b4488b-2110-42eb-a313-5cc720dac7c1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:01.625448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-24b4488b-2110-42eb-a313-5cc720dac7c1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:01.626441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-24b4488b-2110-42eb-a313-5cc720dac7c1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:01.747085 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-24b4488b-2110-42eb-a313-5cc720dac7c1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:01.757835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-24b4488b-2110-42eb-a313-5cc720dac7c1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 200 len: 1225 microversion: 2.1 time: 0.166888 Jul 18 08:53:01.758448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 420/834] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:01 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 1225 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:53:01.792733 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-02ae9027-89b9-42a9-84de-c23ada1aa311 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:01.793175 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-24098e9b-7a09-4163-a4b1-a7e2088de6af tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:01.794254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-02ae9027-89b9-42a9-84de-c23ada1aa311 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:01.801963 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-02ae9027-89b9-42a9-84de-c23ada1aa311 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:01.804488 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-02ae9027-89b9-42a9-84de-c23ada1aa311 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:01.804488 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-02ae9027-89b9-42a9-84de-c23ada1aa311 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:01.804488 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-02ae9027-89b9-42a9-84de-c23ada1aa311 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:01.809627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-24098e9b-7a09-4163-a4b1-a7e2088de6af tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:01.811338 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-24098e9b-7a09-4163-a4b1-a7e2088de6af tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:01.817204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-24098e9b-7a09-4163-a4b1-a7e2088de6af tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.334763 Jul 18 08:53:01.830927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 415/835] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:01 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:01.853175 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-02ae9027-89b9-42a9-84de-c23ada1aa311 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064519 Jul 18 08:53:01.853949 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 421/836] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:53:01 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:53:02.778372 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9b084531-7745-4858-8110-1f0f1e2304ff tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:02.779507 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9b084531-7745-4858-8110-1f0f1e2304ff tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:02.786698 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9b084531-7745-4858-8110-1f0f1e2304ff tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:02.787223 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9b084531-7745-4858-8110-1f0f1e2304ff tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:02.788044 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9b084531-7745-4858-8110-1f0f1e2304ff tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:02.788496 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9b084531-7745-4858-8110-1f0f1e2304ff tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:02.803303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-9b084531-7745-4858-8110-1f0f1e2304ff tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] HTTP exception thrown: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9b084531-7745-4858-8110-1f0f1e2304ff tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Request method failure captured: Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe HTTP/1.1 Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R6fvTPu-KbdM-KWRcpTJQJRS37AynBc6z4z_LRNVzqzJnVlvtn5ouM4UbnEMj1K03x0u78iYramkAeGMYyGOkXGstnlLCA4n0UUPD4_u5F8hQF786OYgyTFQH3yYB9gNSMUNq7n-S0-apWrGwOOYoGLcpTC2IzGtFpmPJO-gr9b9oI Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: d37f9217ffb94786830f0f6c5970b762 Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:53:02.804875 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d37f9217ffb94786830f0f6c5970b762", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: d37f9217ffb94786830f0f6c5970b762 Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-TestVolumeBootPattern-1293900826-project Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: ba4946e9565f4a608dd04fbc4de18dad Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-TestVolumeBootPattern-1293900826-project Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:53:02.806517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'c53c5dca-7e2b-4a47-9a81-7888b20e67fe'} Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:02.807428 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:53:02.808927 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:02.810070 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9b084531-7745-4858-8110-1f0f1e2304ff tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Returning 404 to user: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:02.810070 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9b084531-7745-4858-8110-1f0f1e2304ff tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 404 len: 111 microversion: 2.1 time: 0.033223 Jul 18 08:53:02.810070 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 416/837] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:02 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:53:02.836596 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-658a0341-41cb-44d7-ba13-07e04133c306 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:02.837500 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-658a0341-41cb-44d7-ba13-07e04133c306 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:02.845308 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-658a0341-41cb-44d7-ba13-07e04133c306 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:02.845772 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-658a0341-41cb-44d7-ba13-07e04133c306 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:02.846611 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-658a0341-41cb-44d7-ba13-07e04133c306 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:02.847273 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-658a0341-41cb-44d7-ba13-07e04133c306 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:02.866942 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2f143633-a3e8-4b31-b1a3-a581db3ac2d3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:02.867964 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2f143633-a3e8-4b31-b1a3-a581db3ac2d3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:02.876405 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f143633-a3e8-4b31-b1a3-a581db3ac2d3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:02.876405 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f143633-a3e8-4b31-b1a3-a581db3ac2d3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:02.876405 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f143633-a3e8-4b31-b1a3-a581db3ac2d3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:02.876405 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f143633-a3e8-4b31-b1a3-a581db3ac2d3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:02.936995 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2f143633-a3e8-4b31-b1a3-a581db3ac2d3 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074373 Jul 18 08:53:02.939114 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 417/838] 10.222.0.57 () {58 vars in 1301 bytes} [Mon Jul 18 08:53:02 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 08:53:02.950831 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-955791855", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-239426097", "security_groups": [{"name": "tempest-secgroup-smoke-1587307711"}], "block_device_mapping_v2": [{"uuid": "327b57f0-d072-4fa6-a8d8-99ce827a3c2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "14ef1bb9-db47-48f8-bf4d-197c43ed89fa"}]}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:53:03.030669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-658a0341-41cb-44d7-ba13-07e04133c306 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:03.040312 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-658a0341-41cb-44d7-ba13-07e04133c306 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:03.041794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-658a0341-41cb-44d7-ba13-07e04133c306 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:03.043013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-658a0341-41cb-44d7-ba13-07e04133c306 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.210464 Jul 18 08:53:03.044304 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 422/839] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:02 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:03.051973 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c90d6a2b-1d9e-4cf1-9dc5-a8ea93f1788f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:03.052590 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c90d6a2b-1d9e-4cf1-9dc5-a8ea93f1788f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:03.059302 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c90d6a2b-1d9e-4cf1-9dc5-a8ea93f1788f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:03.060165 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c90d6a2b-1d9e-4cf1-9dc5-a8ea93f1788f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:03.060803 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c90d6a2b-1d9e-4cf1-9dc5-a8ea93f1788f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:03.061253 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c90d6a2b-1d9e-4cf1-9dc5-a8ea93f1788f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:03.096454 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c90d6a2b-1d9e-4cf1-9dc5-a8ea93f1788f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:53:03.147716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] validate_networks() for [('14ef1bb9-db47-48f8-bf4d-197c43ed89fa', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:53:03.993050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:53:03.993607 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:53:03.994011 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:53:03.994448 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:53:03.994884 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:53:04.005382 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:04.005898 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:04.006786 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:04.007248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:04.025382 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Getting quotas for project d37f9217ffb94786830f0f6c5970b762. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:53:04.029532 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Getting quotas for user ba4946e9565f4a608dd04fbc4de18dad and project d37f9217ffb94786830f0f6c5970b762. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:53:04.303361 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:53:04.307124 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='327b57f0-d072-4fa6-a8d8-99ce827a3c2d',volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:53:04.458082 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c90d6a2b-1d9e-4cf1-9dc5-a8ea93f1788f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 204 len: 0 microversion: 2.1 time: 1.412612 Jul 18 08:53:04.459974 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 423/840] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:53:03 2022] DELETE /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 0 bytes in 1416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:53:04.465486 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-34a011bf-0990-4756-bee6-5b83bc6ef5e8 req-cd0ea39e-e017-4529-a1d4-47b8480a554b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18040578-a916-4929-ae00-067b0441f8e7", "name": "network-vif-plugged", "status": "completed", "tag": "87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:53:04.474444 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-34a011bf-0990-4756-bee6-5b83bc6ef5e8 req-cd0ea39e-e017-4529-a1d4-47b8480a554b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:04.474900 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-34a011bf-0990-4756-bee6-5b83bc6ef5e8 req-cd0ea39e-e017-4529-a1d4-47b8480a554b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:04.487442 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-34a011bf-0990-4756-bee6-5b83bc6ef5e8 req-cd0ea39e-e017-4529-a1d4-47b8480a554b service nova] Creating event network-vif-plugged:87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd for instance 18040578-a916-4929-ae00-067b0441f8e7 on hv-cinder-85014 Jul 18 08:53:04.492649 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-34a011bf-0990-4756-bee6-5b83bc6ef5e8 req-cd0ea39e-e017-4529-a1d4-47b8480a554b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031095 Jul 18 08:53:04.493257 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 424/841] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:53:04.498804 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c8d02225-d378-4fd8-9d29-9b151b6f332e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:04.499567 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c8d02225-d378-4fd8-9d29-9b151b6f332e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:04.506863 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8d02225-d378-4fd8-9d29-9b151b6f332e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:04.507448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8d02225-d378-4fd8-9d29-9b151b6f332e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:04.508197 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8d02225-d378-4fd8-9d29-9b151b6f332e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:04.508661 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8d02225-d378-4fd8-9d29-9b151b6f332e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:04.672818 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c8d02225-d378-4fd8-9d29-9b151b6f332e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:04.681559 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c8d02225-d378-4fd8-9d29-9b151b6f332e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:04.683082 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c8d02225-d378-4fd8-9d29-9b151b6f332e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:04.684328 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c8d02225-d378-4fd8-9d29-9b151b6f332e tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.190003 Jul 18 08:53:04.684891 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 425/842] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:04 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:04.696352 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f7dcb7f6-1dee-4bc0-9aa7-93892743c0cb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:04.696966 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f7dcb7f6-1dee-4bc0-9aa7-93892743c0cb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:04.704098 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7dcb7f6-1dee-4bc0-9aa7-93892743c0cb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:04.704758 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7dcb7f6-1dee-4bc0-9aa7-93892743c0cb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:04.705598 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7dcb7f6-1dee-4bc0-9aa7-93892743c0cb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:04.706033 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7dcb7f6-1dee-4bc0-9aa7-93892743c0cb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:04.852786 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d20a4105-9b4f-4d8a-8931-c48c4a9df426 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.907783 Jul 18 08:53:04.856192 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 418/843] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:53:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:53:04.872346 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3c6b30da-1de8-43ed-b35f-877d356e5ad2 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:04.877417 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3c6b30da-1de8-43ed-b35f-877d356e5ad2 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:04.900646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f7dcb7f6-1dee-4bc0-9aa7-93892743c0cb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:04.916935 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f7dcb7f6-1dee-4bc0-9aa7-93892743c0cb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1681 microversion: 2.1 time: 0.224923 Jul 18 08:53:04.927995 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 426/844] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:04 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:04.970295 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3c6b30da-1de8-43ed-b35f-877d356e5ad2 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:04.980924 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3c6b30da-1de8-43ed-b35f-877d356e5ad2 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1093 microversion: 2.1 time: 0.117619 Jul 18 08:53:04.981750 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 419/845] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:04 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1093 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:05.711073 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-29d20356-7f4d-4b2e-8382-b17b624ad5df tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:05.711785 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-29d20356-7f4d-4b2e-8382-b17b624ad5df tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:05.721456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-29d20356-7f4d-4b2e-8382-b17b624ad5df tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:05.721859 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-29d20356-7f4d-4b2e-8382-b17b624ad5df tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:05.722813 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-29d20356-7f4d-4b2e-8382-b17b624ad5df tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:05.723265 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-29d20356-7f4d-4b2e-8382-b17b624ad5df tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:05.936770 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2f85fcc6-e1df-4881-a376-8c3db1b4d5ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:05.939072 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2f85fcc6-e1df-4881-a376-8c3db1b4d5ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:05.945389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-29d20356-7f4d-4b2e-8382-b17b624ad5df tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:05.956986 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f85fcc6-e1df-4881-a376-8c3db1b4d5ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:05.957929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f85fcc6-e1df-4881-a376-8c3db1b4d5ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:05.958926 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f85fcc6-e1df-4881-a376-8c3db1b4d5ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:05.959692 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2f85fcc6-e1df-4881-a376-8c3db1b4d5ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:05.961624 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-29d20356-7f4d-4b2e-8382-b17b624ad5df tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:05.963142 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-29d20356-7f4d-4b2e-8382-b17b624ad5df tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:05.964648 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-29d20356-7f4d-4b2e-8382-b17b624ad5df tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.262451 Jul 18 08:53:05.986735 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 427/846] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:05 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:06.004297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d1abab67-f3b1-4782-b31c-b10b8b79fc49 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:06.005121 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d1abab67-f3b1-4782-b31c-b10b8b79fc49 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:06.026991 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1abab67-f3b1-4782-b31c-b10b8b79fc49 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:06.027455 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1abab67-f3b1-4782-b31c-b10b8b79fc49 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:06.028280 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1abab67-f3b1-4782-b31c-b10b8b79fc49 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:06.028752 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d1abab67-f3b1-4782-b31c-b10b8b79fc49 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:06.121939 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d1abab67-f3b1-4782-b31c-b10b8b79fc49 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:06.122844 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d1abab67-f3b1-4782-b31c-b10b8b79fc49 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1143 microversion: 2.1 time: 0.124161 Jul 18 08:53:06.123495 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 428/847] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:05 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1143 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:53:06.212071 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2f85fcc6-e1df-4881-a376-8c3db1b4d5ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:06.220766 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2f85fcc6-e1df-4881-a376-8c3db1b4d5ad tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1681 microversion: 2.1 time: 0.289973 Jul 18 08:53:06.221343 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 420/848] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:05 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1681 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:53:06.995841 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bf5771d6-72c4-44a8-94ad-8761e03eb65b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:06.997102 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bf5771d6-72c4-44a8-94ad-8761e03eb65b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:07.004272 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bf5771d6-72c4-44a8-94ad-8761e03eb65b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:07.005307 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bf5771d6-72c4-44a8-94ad-8761e03eb65b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:07.006614 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bf5771d6-72c4-44a8-94ad-8761e03eb65b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:07.007334 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bf5771d6-72c4-44a8-94ad-8761e03eb65b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:07.086294 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-a7c9515c-1131-4ef8-97f9-a2f38b66cc89 req-86db96a2-9334-4cb3-8fad-ea942cf94679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab98b057-4071-4710-8fd9-d6d98cc8f159", "name": "network-vif-deleted", "tag": "f3097c6f-2822-4140-90fd-598d399f4804"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:53:07.096774 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-a7c9515c-1131-4ef8-97f9-a2f38b66cc89 req-86db96a2-9334-4cb3-8fad-ea942cf94679 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:07.097333 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-a7c9515c-1131-4ef8-97f9-a2f38b66cc89 req-86db96a2-9334-4cb3-8fad-ea942cf94679 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:07.111687 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-a7c9515c-1131-4ef8-97f9-a2f38b66cc89 req-86db96a2-9334-4cb3-8fad-ea942cf94679 service nova] Creating event network-vif-deleted:f3097c6f-2822-4140-90fd-598d399f4804 for instance ab98b057-4071-4710-8fd9-d6d98cc8f159 on hv-cinder-85014 Jul 18 08:53:07.117575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-a7c9515c-1131-4ef8-97f9-a2f38b66cc89 req-86db96a2-9334-4cb3-8fad-ea942cf94679 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035872 Jul 18 08:53:07.118193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 421/849] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:53:07.152513 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-827032b6-d68c-4fdd-ab03-98bb19698a2c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:07.153392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-827032b6-d68c-4fdd-ab03-98bb19698a2c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:07.161959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-827032b6-d68c-4fdd-ab03-98bb19698a2c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:07.163028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-827032b6-d68c-4fdd-ab03-98bb19698a2c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:07.164128 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-827032b6-d68c-4fdd-ab03-98bb19698a2c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:07.164829 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-827032b6-d68c-4fdd-ab03-98bb19698a2c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:07.210424 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bf5771d6-72c4-44a8-94ad-8761e03eb65b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:07.220441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bf5771d6-72c4-44a8-94ad-8761e03eb65b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:07.224100 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bf5771d6-72c4-44a8-94ad-8761e03eb65b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:07.225654 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bf5771d6-72c4-44a8-94ad-8761e03eb65b tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.234520 Jul 18 08:53:07.248088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 429/850] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:06 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:07.248088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b24b015a-c970-4329-8c4d-da1843229794 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:07.248088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b24b015a-c970-4329-8c4d-da1843229794 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:07.266363 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b24b015a-c970-4329-8c4d-da1843229794 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:07.267737 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b24b015a-c970-4329-8c4d-da1843229794 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:07.268896 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b24b015a-c970-4329-8c4d-da1843229794 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:07.269694 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b24b015a-c970-4329-8c4d-da1843229794 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:07.325906 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-827032b6-d68c-4fdd-ab03-98bb19698a2c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:07.354742 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-827032b6-d68c-4fdd-ab03-98bb19698a2c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1191 microversion: 2.1 time: 0.198303 Jul 18 08:53:07.354742 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 422/851] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:07 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1191 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:07.441817 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b24b015a-c970-4329-8c4d-da1843229794 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:07.453187 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b24b015a-c970-4329-8c4d-da1843229794 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1614 microversion: 2.1 time: 0.215093 Jul 18 08:53:07.454201 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 430/852] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:07 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1614 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:08.270121 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-05cd50d4-392e-4014-b222-ed4dc698d440 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:08.271290 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-05cd50d4-392e-4014-b222-ed4dc698d440 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:08.284658 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-05cd50d4-392e-4014-b222-ed4dc698d440 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:08.286197 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-05cd50d4-392e-4014-b222-ed4dc698d440 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:08.292600 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-05cd50d4-392e-4014-b222-ed4dc698d440 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:08.292600 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-05cd50d4-392e-4014-b222-ed4dc698d440 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:08.361570 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0ce209c6-4a38-4281-b2ad-436c7ebb18a8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:08.362367 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0ce209c6-4a38-4281-b2ad-436c7ebb18a8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:08.371602 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ce209c6-4a38-4281-b2ad-436c7ebb18a8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:08.374538 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ce209c6-4a38-4281-b2ad-436c7ebb18a8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:08.374538 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ce209c6-4a38-4281-b2ad-436c7ebb18a8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:08.374538 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ce209c6-4a38-4281-b2ad-436c7ebb18a8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:08.467195 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0ce209c6-4a38-4281-b2ad-436c7ebb18a8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:08.476486 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0ce209c6-4a38-4281-b2ad-436c7ebb18a8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1209 microversion: 2.1 time: 0.119700 Jul 18 08:53:08.477422 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 431/853] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:08 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:08.481495 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-05cd50d4-392e-4014-b222-ed4dc698d440 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:08.483176 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7b0af63b-6e21-464a-b2f4-0166e1a6521f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:08.484279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7b0af63b-6e21-464a-b2f4-0166e1a6521f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:08.490755 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b0af63b-6e21-464a-b2f4-0166e1a6521f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:08.490991 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-05cd50d4-392e-4014-b222-ed4dc698d440 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:08.491283 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b0af63b-6e21-464a-b2f4-0166e1a6521f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:08.492043 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b0af63b-6e21-464a-b2f4-0166e1a6521f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:08.492659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b0af63b-6e21-464a-b2f4-0166e1a6521f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:08.493421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-05cd50d4-392e-4014-b222-ed4dc698d440 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:08.494894 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-05cd50d4-392e-4014-b222-ed4dc698d440 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.230637 Jul 18 08:53:08.495857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 423/854] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:08 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:08.546403 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b0af63b-6e21-464a-b2f4-0166e1a6521f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:08.547951 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7b0af63b-6e21-464a-b2f4-0166e1a6521f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:08.549361 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-7b0af63b-6e21-464a-b2f4-0166e1a6521f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lazy-loading 'fault' on Instance uuid ab98b057-4071-4710-8fd9-d6d98cc8f159 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:53:08.556339 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:08.636156 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7b0af63b-6e21-464a-b2f4-0166e1a6521f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:08.644100 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7b0af63b-6e21-464a-b2f4-0166e1a6521f tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1331 microversion: 2.1 time: 0.165431 Jul 18 08:53:08.645254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 432/855] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:08 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1331 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:09.494511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9818ed40-2ef6-4300-ae98-d6ded445673f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:09.495101 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9818ed40-2ef6-4300-ae98-d6ded445673f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:09.502010 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9818ed40-2ef6-4300-ae98-d6ded445673f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:09.502509 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9818ed40-2ef6-4300-ae98-d6ded445673f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:09.503305 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9818ed40-2ef6-4300-ae98-d6ded445673f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:09.503768 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9818ed40-2ef6-4300-ae98-d6ded445673f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:09.517643 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-952d052d-be96-486d-8762-3c2c41aa713f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:09.518395 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-952d052d-be96-486d-8762-3c2c41aa713f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:09.526492 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-952d052d-be96-486d-8762-3c2c41aa713f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:09.529093 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-952d052d-be96-486d-8762-3c2c41aa713f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:09.529093 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-952d052d-be96-486d-8762-3c2c41aa713f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:09.529093 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-952d052d-be96-486d-8762-3c2c41aa713f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:09.683062 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-952d052d-be96-486d-8762-3c2c41aa713f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:09.685831 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9818ed40-2ef6-4300-ae98-d6ded445673f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:09.693108 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-952d052d-be96-486d-8762-3c2c41aa713f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:09.694753 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-952d052d-be96-486d-8762-3c2c41aa713f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:09.696088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-952d052d-be96-486d-8762-3c2c41aa713f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.183640 Jul 18 08:53:09.696728 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 433/856] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:09 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:09.704406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9818ed40-2ef6-4300-ae98-d6ded445673f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1277 microversion: 2.1 time: 0.209250 Jul 18 08:53:09.704406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 424/857] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:09 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:09.704625 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-998cf9a2-8861-4964-b9f3-e262522ed59b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:09.704625 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-998cf9a2-8861-4964-b9f3-e262522ed59b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:09.710278 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-998cf9a2-8861-4964-b9f3-e262522ed59b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:09.710701 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-998cf9a2-8861-4964-b9f3-e262522ed59b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:09.712413 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-998cf9a2-8861-4964-b9f3-e262522ed59b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:09.712904 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-998cf9a2-8861-4964-b9f3-e262522ed59b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:09.748339 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-998cf9a2-8861-4964-b9f3-e262522ed59b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:09.754830 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-998cf9a2-8861-4964-b9f3-e262522ed59b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:09.754830 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-998cf9a2-8861-4964-b9f3-e262522ed59b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lazy-loading 'fault' on Instance uuid ab98b057-4071-4710-8fd9-d6d98cc8f159 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:53:09.801387 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-998cf9a2-8861-4964-b9f3-e262522ed59b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:09.810394 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-998cf9a2-8861-4964-b9f3-e262522ed59b tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1331 microversion: 2.1 time: 0.112547 Jul 18 08:53:09.811167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 434/858] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:09 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:10.715915 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-127b5672-0ca5-4896-bba1-20e599d3395f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:10.716593 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-127b5672-0ca5-4896-bba1-20e599d3395f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:10.724371 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-127b5672-0ca5-4896-bba1-20e599d3395f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:10.724817 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-127b5672-0ca5-4896-bba1-20e599d3395f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:10.725585 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-127b5672-0ca5-4896-bba1-20e599d3395f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:10.726013 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-127b5672-0ca5-4896-bba1-20e599d3395f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:10.726139 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0d8a95f9-b3e0-4fa3-9a5b-ea1ccfd6999e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:10.726760 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0d8a95f9-b3e0-4fa3-9a5b-ea1ccfd6999e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:10.738515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0d8a95f9-b3e0-4fa3-9a5b-ea1ccfd6999e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:10.739344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0d8a95f9-b3e0-4fa3-9a5b-ea1ccfd6999e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:10.740784 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0d8a95f9-b3e0-4fa3-9a5b-ea1ccfd6999e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:10.741594 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0d8a95f9-b3e0-4fa3-9a5b-ea1ccfd6999e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:10.928559 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-127b5672-0ca5-4896-bba1-20e599d3395f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:10.938487 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-127b5672-0ca5-4896-bba1-20e599d3395f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:10.940204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-127b5672-0ca5-4896-bba1-20e599d3395f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:10.942053 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-127b5672-0ca5-4896-bba1-20e599d3395f tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1732 microversion: 2.20 time: 0.230084 Jul 18 08:53:10.942909 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 425/859] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:10 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1732 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:10.949823 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-739e9b61-532e-45e3-ba56-fe6de7051b5d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:10.951018 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-739e9b61-532e-45e3-ba56-fe6de7051b5d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:10.960263 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-739e9b61-532e-45e3-ba56-fe6de7051b5d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:10.961007 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-739e9b61-532e-45e3-ba56-fe6de7051b5d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:10.961960 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-739e9b61-532e-45e3-ba56-fe6de7051b5d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:10.962883 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-739e9b61-532e-45e3-ba56-fe6de7051b5d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:11.003271 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-739e9b61-532e-45e3-ba56-fe6de7051b5d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:11.003752 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-739e9b61-532e-45e3-ba56-fe6de7051b5d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:11.004456 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-739e9b61-532e-45e3-ba56-fe6de7051b5d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lazy-loading 'fault' on Instance uuid ab98b057-4071-4710-8fd9-d6d98cc8f159 {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:53:11.025277 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0d8a95f9-b3e0-4fa3-9a5b-ea1ccfd6999e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:11.035310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0d8a95f9-b3e0-4fa3-9a5b-ea1ccfd6999e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1277 microversion: 2.1 time: 0.317684 Jul 18 08:53:11.035983 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 435/860] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:10 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1277 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:11.059055 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-739e9b61-532e-45e3-ba56-fe6de7051b5d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e6b788e0819483580c09902a341ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab95af0a9cb74221a15ac73cbb8ca0ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:11.068297 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-739e9b61-532e-45e3-ba56-fe6de7051b5d tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 200 len: 1331 microversion: 2.1 time: 0.124243 Jul 18 08:53:11.069171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 426/861] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:10 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:11.985311 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3de8f8d3-04e7-40cd-888a-b5f1a2d93769 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:11.987221 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3de8f8d3-04e7-40cd-888a-b5f1a2d93769 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:11.988266 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-15380c46-031b-4d16-978f-c03978dfcf4c req-2118332c-fb74-49bb-a61a-4d91c6de60b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6564cb4f-41b7-4106-ae7b-23423e789831", "tag": "3b545f2f-12bf-41b0-98e3-4c8943c85ca9"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:53:12.002935 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3de8f8d3-04e7-40cd-888a-b5f1a2d93769 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:12.003390 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3de8f8d3-04e7-40cd-888a-b5f1a2d93769 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:12.006575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3de8f8d3-04e7-40cd-888a-b5f1a2d93769 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:12.006575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3de8f8d3-04e7-40cd-888a-b5f1a2d93769 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:12.006915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-15380c46-031b-4d16-978f-c03978dfcf4c req-2118332c-fb74-49bb-a61a-4d91c6de60b1 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:12.007393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-15380c46-031b-4d16-978f-c03978dfcf4c req-2118332c-fb74-49bb-a61a-4d91c6de60b1 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:12.021879 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-15380c46-031b-4d16-978f-c03978dfcf4c req-2118332c-fb74-49bb-a61a-4d91c6de60b1 service nova] Creating event network-changed:3b545f2f-12bf-41b0-98e3-4c8943c85ca9 for instance 6564cb4f-41b7-4106-ae7b-23423e789831 on hv-cinder-85014 Jul 18 08:53:12.030217 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-15380c46-031b-4d16-978f-c03978dfcf4c req-2118332c-fb74-49bb-a61a-4d91c6de60b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071604 Jul 18 08:53:12.033154 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 436/862] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:53:12.053331 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c89c8cef-6b23-424f-85da-837d08553742 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:12.058232 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c89c8cef-6b23-424f-85da-837d08553742 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:12.065562 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c89c8cef-6b23-424f-85da-837d08553742 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:12.066032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c89c8cef-6b23-424f-85da-837d08553742 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:12.066875 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c89c8cef-6b23-424f-85da-837d08553742 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:12.067324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c89c8cef-6b23-424f-85da-837d08553742 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:12.189054 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3de8f8d3-04e7-40cd-888a-b5f1a2d93769 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:12.199828 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3de8f8d3-04e7-40cd-888a-b5f1a2d93769 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:12.202001 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3de8f8d3-04e7-40cd-888a-b5f1a2d93769 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:12.204506 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3de8f8d3-04e7-40cd-888a-b5f1a2d93769 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1719 microversion: 2.20 time: 0.241630 Jul 18 08:53:12.205096 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 427/863] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:11 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1719 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:12.221871 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c9bfb2d2-0181-42bb-832c-a28d2db7c360 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:12.223321 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c9bfb2d2-0181-42bb-832c-a28d2db7c360 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:12.232586 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c9bfb2d2-0181-42bb-832c-a28d2db7c360 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:12.235637 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c9bfb2d2-0181-42bb-832c-a28d2db7c360 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:12.237010 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c9bfb2d2-0181-42bb-832c-a28d2db7c360 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:12.239807 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c9bfb2d2-0181-42bb-832c-a28d2db7c360 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:12.271079 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-c9bfb2d2-0181-42bb-832c-a28d2db7c360 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c9bfb2d2-0181-42bb-832c-a28d2db7c360 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 HTTP/1.1 Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:53:12.273430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:12.278341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'ab98b057-4071-4710-8fd9-d6d98cc8f159'} Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:12.279443 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:12.280722 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:12.283209 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c9bfb2d2-0181-42bb-832c-a28d2db7c360 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:12.283209 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c9bfb2d2-0181-42bb-832c-a28d2db7c360 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 404 len: 111 microversion: 2.1 time: 0.069324 Jul 18 08:53:12.291514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 428/864] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:12 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:53:12.297982 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-859923a4-5771-414f-ac66-07317a3366fb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '.version_select at 0x7fafb7137430>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:12.456503 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c89c8cef-6b23-424f-85da-837d08553742 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:12.471446 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c89c8cef-6b23-424f-85da-837d08553742 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1277 microversion: 2.1 time: 0.422375 Jul 18 08:53:12.472114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 437/865] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:12 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1277 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:53:12.503800 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-859923a4-5771-414f-ac66-07317a3366fb tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031141248" status: 202 len: 0 microversion: 2.1 time: 0.210865 Jul 18 08:53:12.504527 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 429/866] 10.222.0.57 () {58 vars in 1220 bytes} [Mon Jul 18 08:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031141248 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:53:13.490216 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d4abe399-95ce-4e2f-8de4-3684d10b39c9 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:13.491059 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d4abe399-95ce-4e2f-8de4-3684d10b39c9 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:13.498271 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d4abe399-95ce-4e2f-8de4-3684d10b39c9 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:13.498774 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d4abe399-95ce-4e2f-8de4-3684d10b39c9 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:13.499594 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d4abe399-95ce-4e2f-8de4-3684d10b39c9 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:13.500312 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d4abe399-95ce-4e2f-8de4-3684d10b39c9 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:13.653556 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d4abe399-95ce-4e2f-8de4-3684d10b39c9 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:13.662832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d4abe399-95ce-4e2f-8de4-3684d10b39c9 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.175721 Jul 18 08:53:13.662832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 438/867] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:13 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:14.676272 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:14.680300 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d4e5c222-b8a9-41b1-94b7-ad668986d8e1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:14.680887 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d4e5c222-b8a9-41b1-94b7-ad668986d8e1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:14.687929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d4e5c222-b8a9-41b1-94b7-ad668986d8e1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:14.690171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d4e5c222-b8a9-41b1-94b7-ad668986d8e1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:14.690171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d4e5c222-b8a9-41b1-94b7-ad668986d8e1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:14.690171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d4e5c222-b8a9-41b1-94b7-ad668986d8e1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:14.824546 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d4e5c222-b8a9-41b1-94b7-ad668986d8e1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:14.832707 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d4e5c222-b8a9-41b1-94b7-ad668986d8e1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.157779 Jul 18 08:53:14.833313 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 430/868] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:14 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:14.918281 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7509e7c3-e676-42e5-b1ce-07cd7471f9af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:14.918779 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7509e7c3-e676-42e5-b1ce-07cd7471f9af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:14.926327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7509e7c3-e676-42e5-b1ce-07cd7471f9af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:14.926793 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7509e7c3-e676-42e5-b1ce-07cd7471f9af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:14.927612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7509e7c3-e676-42e5-b1ce-07cd7471f9af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:14.928072 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7509e7c3-e676-42e5-b1ce-07cd7471f9af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:14.941958 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-7509e7c3-e676-42e5-b1ce-07cd7471f9af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7509e7c3-e676-42e5-b1ce-07cd7471f9af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: DELETE /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 HTTP/1.1 Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:53:14.943657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:14.945222 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': 'ab98b057-4071-4710-8fd9-d6d98cc8f159'} Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:14.946130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:14.947848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:14.949441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7509e7c3-e676-42e5-b1ce-07cd7471f9af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:14.949441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7509e7c3-e676-42e5-b1ce-07cd7471f9af tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 404 len: 111 microversion: 2.1 time: 0.030807 Jul 18 08:53:14.949441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 439/869] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:53:14 2022] DELETE /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:53:14.954583 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5b161705-c407-4a35-80a4-a9624a150775 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:14.955187 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-5b161705-c407-4a35-80a4-a9624a150775 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: ab98b057-4071-4710-8fd9-d6d98cc8f159] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:14.961622 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b161705-c407-4a35-80a4-a9624a150775 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:14.962075 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b161705-c407-4a35-80a4-a9624a150775 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:14.962834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b161705-c407-4a35-80a4-a9624a150775 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:14.963269 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-5b161705-c407-4a35-80a4-a9624a150775 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:14.976839 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=8 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:14.978610 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-5b161705-c407-4a35-80a4-a9624a150775 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5b161705-c407-4a35-80a4-a9624a150775 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 HTTP/1.1 Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:53:14.980208 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:14.981880 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'ab98b057-4071-4710-8fd9-d6d98cc8f159'} Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:14.982837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. Jul 18 08:53:14.984190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:14.986497 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-5b161705-c407-4a35-80a4-a9624a150775 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance ab98b057-4071-4710-8fd9-d6d98cc8f159 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:14.986497 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-5b161705-c407-4a35-80a4-a9624a150775 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159" status: 404 len: 111 microversion: 2.1 time: 0.031214 Jul 18 08:53:14.986497 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 431/870] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:14 2022] GET /compute/v2.1/servers/ab98b057-4071-4710-8fd9-d6d98cc8f159 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:53:15.850240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-48d5b954-e169-4f7c-8a0b-c7ffed287579 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:15.850882 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-48d5b954-e169-4f7c-8a0b-c7ffed287579 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:15.857053 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48d5b954-e169-4f7c-8a0b-c7ffed287579 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:15.857504 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48d5b954-e169-4f7c-8a0b-c7ffed287579 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:15.858318 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48d5b954-e169-4f7c-8a0b-c7ffed287579 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:15.858823 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-48d5b954-e169-4f7c-8a0b-c7ffed287579 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:15.999005 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-48d5b954-e169-4f7c-8a0b-c7ffed287579 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:16.007289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-48d5b954-e169-4f7c-8a0b-c7ffed287579 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.161645 Jul 18 08:53:16.012895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 440/871] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:15 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:17.025645 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0347518d-4a41-48fc-98fa-656e8e514d40 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:17.026349 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0347518d-4a41-48fc-98fa-656e8e514d40 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:17.028798 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:17.034178 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0347518d-4a41-48fc-98fa-656e8e514d40 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:17.039300 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0347518d-4a41-48fc-98fa-656e8e514d40 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:17.039300 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0347518d-4a41-48fc-98fa-656e8e514d40 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:17.039300 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0347518d-4a41-48fc-98fa-656e8e514d40 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:17.200947 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0347518d-4a41-48fc-98fa-656e8e514d40 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:17.209374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0347518d-4a41-48fc-98fa-656e8e514d40 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.188681 Jul 18 08:53:17.209936 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 432/872] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:17 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:18.228260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8612b759-fc11-43f0-9fe9-a7dabdacaab4 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:18.228865 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8612b759-fc11-43f0-9fe9-a7dabdacaab4 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:18.235608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8612b759-fc11-43f0-9fe9-a7dabdacaab4 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:18.236075 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8612b759-fc11-43f0-9fe9-a7dabdacaab4 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:18.236842 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8612b759-fc11-43f0-9fe9-a7dabdacaab4 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:18.237283 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8612b759-fc11-43f0-9fe9-a7dabdacaab4 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:18.402876 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-036649f9-e731-4caa-baa8-5e62787b5ebf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:18.403478 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-036649f9-e731-4caa-baa8-5e62787b5ebf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:18.410683 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-036649f9-e731-4caa-baa8-5e62787b5ebf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:18.411141 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-036649f9-e731-4caa-baa8-5e62787b5ebf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:18.411972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-036649f9-e731-4caa-baa8-5e62787b5ebf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:18.413005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-036649f9-e731-4caa-baa8-5e62787b5ebf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:18.434657 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-036649f9-e731-4caa-baa8-5e62787b5ebf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-036649f9-e731-4caa-baa8-5e62787b5ebf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: DELETE /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 HTTP/1.1 Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:53:18.436845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:53:18.438292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'b503f6b2-890d-41b0-9323-5af163d8a016'} Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:18.439094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:53:18.440470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.441739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-036649f9-e731-4caa-baa8-5e62787b5ebf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:18.441739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-036649f9-e731-4caa-baa8-5e62787b5ebf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 404 len: 111 microversion: 2.1 time: 0.039097 Jul 18 08:53:18.441739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 433/873] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:53:18 2022] DELETE /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:53:18.448293 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8a891f19-cfb9-46e2-9cd8-5d41e415c2c1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:18.449022 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8a891f19-cfb9-46e2-9cd8-5d41e415c2c1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: b503f6b2-890d-41b0-9323-5af163d8a016] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:18.451859 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8612b759-fc11-43f0-9fe9-a7dabdacaab4 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:18.457477 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8a891f19-cfb9-46e2-9cd8-5d41e415c2c1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:18.457477 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8a891f19-cfb9-46e2-9cd8-5d41e415c2c1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:18.458158 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8a891f19-cfb9-46e2-9cd8-5d41e415c2c1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:18.458158 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8a891f19-cfb9-46e2-9cd8-5d41e415c2c1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:18.461873 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8612b759-fc11-43f0-9fe9-a7dabdacaab4 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.238815 Jul 18 08:53:18.463498 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 441/874] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:18 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:18.474901 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-8a891f19-cfb9-46e2-9cd8-5d41e415c2c1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8a891f19-cfb9-46e2-9cd8-5d41e415c2c1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 HTTP/1.1 Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:53:18.477220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:53:18.478872 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'b503f6b2-890d-41b0-9323-5af163d8a016'} Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:18.479743 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. Jul 18 08:53:18.481028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.482214 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8a891f19-cfb9-46e2-9cd8-5d41e415c2c1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance b503f6b2-890d-41b0-9323-5af163d8a016 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:18.482214 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8a891f19-cfb9-46e2-9cd8-5d41e415c2c1 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016" status: 404 len: 111 microversion: 2.1 time: 0.035693 Jul 18 08:53:18.482214 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 434/875] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:18 2022] GET /compute/v2.1/servers/b503f6b2-890d-41b0-9323-5af163d8a016 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:53:18.489311 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c4deb286-be81-4a2f-8f7b-5c103efad942 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:18.489806 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c4deb286-be81-4a2f-8f7b-5c103efad942 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:18.497009 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c4deb286-be81-4a2f-8f7b-5c103efad942 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:18.497459 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c4deb286-be81-4a2f-8f7b-5c103efad942 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:18.498239 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c4deb286-be81-4a2f-8f7b-5c103efad942 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:18.498674 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c4deb286-be81-4a2f-8f7b-5c103efad942 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:18.513964 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-c4deb286-be81-4a2f-8f7b-5c103efad942 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c4deb286-be81-4a2f-8f7b-5c103efad942 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: DELETE /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 HTTP/1.1 Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:53:18.515554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:53:18.518083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '3b5a1195-56c1-4745-8903-f6bba84a4d19'} Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:18.519231 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:53:18.520867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.523102 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c4deb286-be81-4a2f-8f7b-5c103efad942 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:18.523102 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c4deb286-be81-4a2f-8f7b-5c103efad942 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 404 len: 111 microversion: 2.1 time: 0.033828 Jul 18 08:53:18.523102 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 442/876] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:53:18 2022] DELETE /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:53:18.527139 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8259794f-693e-40dc-a1c8-335be5667de4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:18.527824 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8259794f-693e-40dc-a1c8-335be5667de4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 3b5a1195-56c1-4745-8903-f6bba84a4d19] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:18.534977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8259794f-693e-40dc-a1c8-335be5667de4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:18.535444 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8259794f-693e-40dc-a1c8-335be5667de4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:18.536397 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8259794f-693e-40dc-a1c8-335be5667de4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:18.536838 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8259794f-693e-40dc-a1c8-335be5667de4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:18.553961 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-8259794f-693e-40dc-a1c8-335be5667de4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8259794f-693e-40dc-a1c8-335be5667de4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 HTTP/1.1 Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:53:18.555514 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:53:18.557131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': '3b5a1195-56c1-4745-8903-f6bba84a4d19'} Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:18.558006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. Jul 18 08:53:18.559360 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:18.560467 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8259794f-693e-40dc-a1c8-335be5667de4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance 3b5a1195-56c1-4745-8903-f6bba84a4d19 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:18.560467 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8259794f-693e-40dc-a1c8-335be5667de4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19" status: 404 len: 111 microversion: 2.1 time: 0.033975 Jul 18 08:53:18.560467 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 435/877] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:18 2022] GET /compute/v2.1/servers/3b5a1195-56c1-4745-8903-f6bba84a4d19 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:53:19.480904 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0a1dd5e4-0fc1-4741-81fb-1b81e4cba73e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:19.481592 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0a1dd5e4-0fc1-4741-81fb-1b81e4cba73e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:19.488703 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0a1dd5e4-0fc1-4741-81fb-1b81e4cba73e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:19.489191 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0a1dd5e4-0fc1-4741-81fb-1b81e4cba73e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:19.489964 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0a1dd5e4-0fc1-4741-81fb-1b81e4cba73e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:19.490999 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0a1dd5e4-0fc1-4741-81fb-1b81e4cba73e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:19.659583 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0a1dd5e4-0fc1-4741-81fb-1b81e4cba73e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:19.667516 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0a1dd5e4-0fc1-4741-81fb-1b81e4cba73e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.190667 Jul 18 08:53:19.668145 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 443/878] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:19 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:19.875866 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-80054dd4-b853-465a-86a7-e840bf1d52cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:19.876694 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-80054dd4-b853-465a-86a7-e840bf1d52cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:19.884199 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80054dd4-b853-465a-86a7-e840bf1d52cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:19.884648 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80054dd4-b853-465a-86a7-e840bf1d52cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:19.885461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80054dd4-b853-465a-86a7-e840bf1d52cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:19.885876 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-80054dd4-b853-465a-86a7-e840bf1d52cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:19.900615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-80054dd4-b853-465a-86a7-e840bf1d52cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-80054dd4-b853-465a-86a7-e840bf1d52cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: DELETE /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 HTTP/1.1 Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:53:19.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:53:19.903940 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': '866bad59-8906-4710-9fbb-63e95c376010'} Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:19.904857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:53:19.906303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:19.907852 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-80054dd4-b853-465a-86a7-e840bf1d52cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:19.907852 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-80054dd4-b853-465a-86a7-e840bf1d52cf tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "DELETE /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 404 len: 111 microversion: 2.1 time: 0.031754 Jul 18 08:53:19.907852 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 436/879] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:53:19 2022] DELETE /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:53:19.913375 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-590598a3-e61b-40fd-a06b-661f83516ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:19.914260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-590598a3-e61b-40fd-a06b-661f83516ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] [instance: 866bad59-8906-4710-9fbb-63e95c376010] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:19.920471 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-590598a3-e61b-40fd-a06b-661f83516ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:19.920921 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-590598a3-e61b-40fd-a06b-661f83516ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:19.921682 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-590598a3-e61b-40fd-a06b-661f83516ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:19.922131 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-590598a3-e61b-40fd-a06b-661f83516ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:19.936828 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-590598a3-e61b-40fd-a06b-661f83516ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] HTTP exception thrown: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-590598a3-e61b-40fd-a06b-661f83516ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Request method failure captured: Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 HTTP/1.1 Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3aUnrCVZPtzil2KVDYbN5lWzyU9L1FGrZRb8gUJFFAIqeWiP_f5x7k0kl5BsJ7fXshAtJ8P6Oa1IEDdSRlxKIAQuk0X6vGabdHHxkGG1pA1QSmwNmwYIIae4LkMV61G-wgOhm6ZT4JG_r5yjJPWnwOJrJHLnOGOEADmRahW44SaDc Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:53:19.939303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ab95af0a9cb74221a15ac73cbb8ca0ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ab95af0a9cb74221a15ac73cbb8ca0ff", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: ab95af0a9cb74221a15ac73cbb8ca0ff Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1345636204 Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 4e6b788e0819483580c09902a341ea6d Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeNegativeTest-1345636204-project Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:53:19.941928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '866bad59-8906-4710-9fbb-63e95c376010'} Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:19.942895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. Jul 18 08:53:19.944573 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:19.945673 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-590598a3-e61b-40fd-a06b-661f83516ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] Returning 404 to user: Instance 866bad59-8906-4710-9fbb-63e95c376010 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:19.945673 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-590598a3-e61b-40fd-a06b-661f83516ff4 tempest-AttachVolumeNegativeTest-1345636204 tempest-AttachVolumeNegativeTest-1345636204-project] 10.222.0.57 "GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010" status: 404 len: 111 microversion: 2.1 time: 0.032174 Jul 18 08:53:19.947050 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 444/880] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:19 2022] GET /compute/v2.1/servers/866bad59-8906-4710-9fbb-63e95c376010 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:53:20.686737 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7dfec9bf-71f5-4f54-877f-fdf06f3e8e70 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:20.687429 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7dfec9bf-71f5-4f54-877f-fdf06f3e8e70 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:20.695353 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7dfec9bf-71f5-4f54-877f-fdf06f3e8e70 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:20.696172 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7dfec9bf-71f5-4f54-877f-fdf06f3e8e70 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:20.697386 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7dfec9bf-71f5-4f54-877f-fdf06f3e8e70 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:20.697842 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7dfec9bf-71f5-4f54-877f-fdf06f3e8e70 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:20.933307 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7dfec9bf-71f5-4f54-877f-fdf06f3e8e70 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:20.937675 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=100 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:20.942855 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7dfec9bf-71f5-4f54-877f-fdf06f3e8e70 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.262076 Jul 18 08:53:20.944219 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 437/881] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:20 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:21.961867 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9d5f40e7-cb69-499d-825e-98b4f7c00fb3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:21.963122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9d5f40e7-cb69-499d-825e-98b4f7c00fb3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:21.972275 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9d5f40e7-cb69-499d-825e-98b4f7c00fb3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:21.973044 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9d5f40e7-cb69-499d-825e-98b4f7c00fb3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:21.974718 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9d5f40e7-cb69-499d-825e-98b4f7c00fb3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:21.976048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9d5f40e7-cb69-499d-825e-98b4f7c00fb3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:22.130754 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-9d5f40e7-cb69-499d-825e-98b4f7c00fb3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:22.139370 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9d5f40e7-cb69-499d-825e-98b4f7c00fb3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.182132 Jul 18 08:53:22.140103 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 445/882] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:21 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:23.157676 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-29a46243-8c67-4f4c-abe7-73e1a2a95e69 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:23.158292 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-29a46243-8c67-4f4c-abe7-73e1a2a95e69 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:23.165078 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-29a46243-8c67-4f4c-abe7-73e1a2a95e69 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:23.166094 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-29a46243-8c67-4f4c-abe7-73e1a2a95e69 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:23.166285 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-29a46243-8c67-4f4c-abe7-73e1a2a95e69 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:23.166721 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-29a46243-8c67-4f4c-abe7-73e1a2a95e69 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:23.336673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-29a46243-8c67-4f4c-abe7-73e1a2a95e69 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:23.348771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-29a46243-8c67-4f4c-abe7-73e1a2a95e69 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.195256 Jul 18 08:53:23.349416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 438/883] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:23 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:24.374447 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-697d32ea-1eeb-4454-a9c9-1c9372c37f8d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:24.375182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-697d32ea-1eeb-4454-a9c9-1c9372c37f8d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:24.382211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-697d32ea-1eeb-4454-a9c9-1c9372c37f8d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:24.382673 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-697d32ea-1eeb-4454-a9c9-1c9372c37f8d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:24.383473 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-697d32ea-1eeb-4454-a9c9-1c9372c37f8d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:24.383935 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-697d32ea-1eeb-4454-a9c9-1c9372c37f8d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:24.620366 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-697d32ea-1eeb-4454-a9c9-1c9372c37f8d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:24.634309 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-697d32ea-1eeb-4454-a9c9-1c9372c37f8d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.263662 Jul 18 08:53:24.643729 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 446/884] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:24 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:25.402697 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-1643638e-f783-442b-a743-9716fc9c33d8 req-6c097723-0e26-4c1f-aeea-f33f0985e0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6564cb4f-41b7-4106-ae7b-23423e789831", "name": "network-vif-plugged", "status": "completed", "tag": "3b545f2f-12bf-41b0-98e3-4c8943c85ca9"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:53:25.424308 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-1643638e-f783-442b-a743-9716fc9c33d8 req-6c097723-0e26-4c1f-aeea-f33f0985e0f9 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:25.424764 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-1643638e-f783-442b-a743-9716fc9c33d8 req-6c097723-0e26-4c1f-aeea-f33f0985e0f9 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:25.438051 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-1643638e-f783-442b-a743-9716fc9c33d8 req-6c097723-0e26-4c1f-aeea-f33f0985e0f9 service nova] Creating event network-vif-plugged:3b545f2f-12bf-41b0-98e3-4c8943c85ca9 for instance 6564cb4f-41b7-4106-ae7b-23423e789831 on hv-cinder-85014 Jul 18 08:53:25.443790 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-1643638e-f783-442b-a743-9716fc9c33d8 req-6c097723-0e26-4c1f-aeea-f33f0985e0f9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055900 Jul 18 08:53:25.445264 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 439/885] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:53:25.657123 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-09fbfd08-0d8a-46ca-8cf5-4a8a2fc5069f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:25.657767 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-09fbfd08-0d8a-46ca-8cf5-4a8a2fc5069f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:25.660270 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:25.665187 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09fbfd08-0d8a-46ca-8cf5-4a8a2fc5069f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:25.665634 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09fbfd08-0d8a-46ca-8cf5-4a8a2fc5069f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:25.666408 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09fbfd08-0d8a-46ca-8cf5-4a8a2fc5069f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:25.666843 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-09fbfd08-0d8a-46ca-8cf5-4a8a2fc5069f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:25.819490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-09fbfd08-0d8a-46ca-8cf5-4a8a2fc5069f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:25.828734 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-09fbfd08-0d8a-46ca-8cf5-4a8a2fc5069f tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.175597 Jul 18 08:53:25.830812 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 447/886] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:25 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:26.848225 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7ef1b8c8-5ad6-4c64-ada2-15fddfb3b51c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:26.850382 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7ef1b8c8-5ad6-4c64-ada2-15fddfb3b51c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:26.857163 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ef1b8c8-5ad6-4c64-ada2-15fddfb3b51c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:26.857610 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ef1b8c8-5ad6-4c64-ada2-15fddfb3b51c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:26.858381 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ef1b8c8-5ad6-4c64-ada2-15fddfb3b51c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:26.858822 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7ef1b8c8-5ad6-4c64-ada2-15fddfb3b51c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:27.009425 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7ef1b8c8-5ad6-4c64-ada2-15fddfb3b51c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:27.017086 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7ef1b8c8-5ad6-4c64-ada2-15fddfb3b51c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.173511 Jul 18 08:53:27.017646 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 440/887] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:26 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:28.037058 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-854a6286-318c-4fd6-b7ec-d1b60a3b33a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:28.037699 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-854a6286-318c-4fd6-b7ec-d1b60a3b33a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:28.045408 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-854a6286-318c-4fd6-b7ec-d1b60a3b33a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:28.045855 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-854a6286-318c-4fd6-b7ec-d1b60a3b33a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:28.046637 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-854a6286-318c-4fd6-b7ec-d1b60a3b33a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:28.047101 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-854a6286-318c-4fd6-b7ec-d1b60a3b33a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:28.193645 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-854a6286-318c-4fd6-b7ec-d1b60a3b33a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:28.203477 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-854a6286-318c-4fd6-b7ec-d1b60a3b33a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.171467 Jul 18 08:53:28.204410 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 448/888] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:28 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:29.223503 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-28ef5654-8671-4ea8-834e-4851ccbf0428 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:29.224186 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-28ef5654-8671-4ea8-834e-4851ccbf0428 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:29.232793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-28ef5654-8671-4ea8-834e-4851ccbf0428 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:29.233237 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-28ef5654-8671-4ea8-834e-4851ccbf0428 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:29.234000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-28ef5654-8671-4ea8-834e-4851ccbf0428 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:29.234429 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-28ef5654-8671-4ea8-834e-4851ccbf0428 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:29.399956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-28ef5654-8671-4ea8-834e-4851ccbf0428 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:29.408604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-28ef5654-8671-4ea8-834e-4851ccbf0428 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1265 microversion: 2.1 time: 0.188429 Jul 18 08:53:29.408604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 441/889] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:29 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:30.425674 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f8a2b16e-0b8b-4fd8-941d-64552ba1a5a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:30.426292 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f8a2b16e-0b8b-4fd8-941d-64552ba1a5a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:30.433615 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f8a2b16e-0b8b-4fd8-941d-64552ba1a5a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:30.434061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f8a2b16e-0b8b-4fd8-941d-64552ba1a5a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:30.434852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f8a2b16e-0b8b-4fd8-941d-64552ba1a5a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:30.435895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f8a2b16e-0b8b-4fd8-941d-64552ba1a5a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:30.580711 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f8a2b16e-0b8b-4fd8-941d-64552ba1a5a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:30.588837 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f8a2b16e-0b8b-4fd8-941d-64552ba1a5a7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1452 microversion: 2.1 time: 0.167126 Jul 18 08:53:30.592738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 449/890] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:30 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:30.606181 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3fd21bca-5d25-4b94-958f-290c67da832e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:30.606800 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3fd21bca-5d25-4b94-958f-290c67da832e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:30.613365 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3fd21bca-5d25-4b94-958f-290c67da832e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:30.613819 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3fd21bca-5d25-4b94-958f-290c67da832e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:30.614584 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3fd21bca-5d25-4b94-958f-290c67da832e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:30.615053 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3fd21bca-5d25-4b94-958f-290c67da832e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:30.755393 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3fd21bca-5d25-4b94-958f-290c67da832e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:30.763282 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3fd21bca-5d25-4b94-958f-290c67da832e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1452 microversion: 2.1 time: 0.161280 Jul 18 08:53:30.763959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 442/891] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:53:30 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:53:32.962738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-83074cae-bab3-40fe-b316-9b965711e421 req-1f2ba4b1-9ef1-4368-8fe3-b1267844996b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6564cb4f-41b7-4106-ae7b-23423e789831", "tag": "3b545f2f-12bf-41b0-98e3-4c8943c85ca9"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:53:32.971371 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-83074cae-bab3-40fe-b316-9b965711e421 req-1f2ba4b1-9ef1-4368-8fe3-b1267844996b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:32.971888 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-83074cae-bab3-40fe-b316-9b965711e421 req-1f2ba4b1-9ef1-4368-8fe3-b1267844996b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:32.986061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-83074cae-bab3-40fe-b316-9b965711e421 req-1f2ba4b1-9ef1-4368-8fe3-b1267844996b service nova] Creating event network-changed:3b545f2f-12bf-41b0-98e3-4c8943c85ca9 for instance 6564cb4f-41b7-4106-ae7b-23423e789831 on hv-cinder-85014 Jul 18 08:53:32.990357 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-83074cae-bab3-40fe-b316-9b965711e421 req-1f2ba4b1-9ef1-4368-8fe3-b1267844996b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031653 Jul 18 08:53:32.991546 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 450/892] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:53:49.217228 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0274d702-e226-411c-b130-a5c58d6cb100 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:49.218214 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0274d702-e226-411c-b130-a5c58d6cb100 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:49.220545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=21 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:49.225688 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=26 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:49.225988 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0274d702-e226-411c-b130-a5c58d6cb100 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:49.226365 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0274d702-e226-411c-b130-a5c58d6cb100 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:49.227131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0274d702-e226-411c-b130-a5c58d6cb100 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:49.227568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0274d702-e226-411c-b130-a5c58d6cb100 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:49.258613 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0274d702-e226-411c-b130-a5c58d6cb100 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046180 Jul 18 08:53:49.259180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 443/893] 10.222.0.57 () {60 vars in 1342 bytes} [Mon Jul 18 08:53:49 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:53:49.316184 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=7 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:49.316927 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=93 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:53:49.321469 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-172e8a0c-98a0-43fe-93eb-7470d1bc4d35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:49.322043 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-172e8a0c-98a0-43fe-93eb-7470d1bc4d35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:49.329518 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-172e8a0c-98a0-43fe-93eb-7470d1bc4d35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:49.329968 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-172e8a0c-98a0-43fe-93eb-7470d1bc4d35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:49.330752 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-172e8a0c-98a0-43fe-93eb-7470d1bc4d35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:49.331205 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-172e8a0c-98a0-43fe-93eb-7470d1bc4d35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:49.356662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-172e8a0c-98a0-43fe-93eb-7470d1bc4d35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:53:49.693063 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-172e8a0c-98a0-43fe-93eb-7470d1bc4d35 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "DELETE /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 204 len: 0 microversion: 2.20 time: 0.378148 Jul 18 08:53:49.693651 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 451/894] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 08:53:49 2022] DELETE /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 08:53:49.702340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-afe6f1cc-db60-4b3f-90b1-e1f91b532271 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:49.702948 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-afe6f1cc-db60-4b3f-90b1-e1f91b532271 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:49.709914 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-afe6f1cc-db60-4b3f-90b1-e1f91b532271 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:49.710369 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-afe6f1cc-db60-4b3f-90b1-e1f91b532271 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:49.711140 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-afe6f1cc-db60-4b3f-90b1-e1f91b532271 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:49.711580 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-afe6f1cc-db60-4b3f-90b1-e1f91b532271 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:49.847211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-afe6f1cc-db60-4b3f-90b1-e1f91b532271 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:49.856163 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-afe6f1cc-db60-4b3f-90b1-e1f91b532271 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:49.857656 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-afe6f1cc-db60-4b3f-90b1-e1f91b532271 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:49.858812 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-afe6f1cc-db60-4b3f-90b1-e1f91b532271 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.160822 Jul 18 08:53:49.859381 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 444/895] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:49 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:50.878212 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-35e5c2b1-bb26-4b3c-a210-cd770d2495ad tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:50.879017 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-35e5c2b1-bb26-4b3c-a210-cd770d2495ad tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:50.885579 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-35e5c2b1-bb26-4b3c-a210-cd770d2495ad tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:50.886031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-35e5c2b1-bb26-4b3c-a210-cd770d2495ad tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:50.886794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-35e5c2b1-bb26-4b3c-a210-cd770d2495ad tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:50.887915 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-35e5c2b1-bb26-4b3c-a210-cd770d2495ad tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:51.283260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-35e5c2b1-bb26-4b3c-a210-cd770d2495ad tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:51.291597 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-35e5c2b1-bb26-4b3c-a210-cd770d2495ad tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:51.293182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-35e5c2b1-bb26-4b3c-a210-cd770d2495ad tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:51.294890 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-35e5c2b1-bb26-4b3c-a210-cd770d2495ad tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1725 microversion: 2.20 time: 0.420975 Jul 18 08:53:51.295449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 452/896] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:50 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1725 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:52.239191 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-395b9563-5c16-4c09-9e3f-7280d5454823 req-6513f346-c2b5-4406-928c-0804488ed1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18040578-a916-4929-ae00-067b0441f8e7", "name": "network-vif-deleted", "tag": "87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:53:52.251286 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-395b9563-5c16-4c09-9e3f-7280d5454823 req-6513f346-c2b5-4406-928c-0804488ed1fd service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:52.251761 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-395b9563-5c16-4c09-9e3f-7280d5454823 req-6513f346-c2b5-4406-928c-0804488ed1fd service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:52.263725 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-395b9563-5c16-4c09-9e3f-7280d5454823 req-6513f346-c2b5-4406-928c-0804488ed1fd service nova] Creating event network-vif-deleted:87f9bc31-3edd-4ea6-aeeb-1fc225fbdccd for instance 18040578-a916-4929-ae00-067b0441f8e7 on hv-cinder-85014 Jul 18 08:53:52.269178 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-395b9563-5c16-4c09-9e3f-7280d5454823 req-6513f346-c2b5-4406-928c-0804488ed1fd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033695 Jul 18 08:53:52.269889 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 445/897] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:53:52.313643 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-59c75174-e571-46a5-91e0-7a7ddab74329 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:52.314264 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-59c75174-e571-46a5-91e0-7a7ddab74329 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:52.320950 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-59c75174-e571-46a5-91e0-7a7ddab74329 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:52.321731 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-59c75174-e571-46a5-91e0-7a7ddab74329 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:52.322515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-59c75174-e571-46a5-91e0-7a7ddab74329 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:52.322951 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-59c75174-e571-46a5-91e0-7a7ddab74329 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:52.427441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-59c75174-e571-46a5-91e0-7a7ddab74329 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:52.438502 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-59c75174-e571-46a5-91e0-7a7ddab74329 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:52.442580 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-59c75174-e571-46a5-91e0-7a7ddab74329 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88b4bd52ede644f0aac8dff94e09dd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2947427ce24f46baad0172db285cc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:53:52.444588 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-59c75174-e571-46a5-91e0-7a7ddab74329 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 200 len: 1657 microversion: 2.20 time: 0.135027 Jul 18 08:53:52.445700 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 453/898] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:52 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 1657 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 08:53:53.466512 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7783c80d-a296-48cc-9de0-2f4d1f584e29 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:53.467211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7783c80d-a296-48cc-9de0-2f4d1f584e29 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:53.474120 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7783c80d-a296-48cc-9de0-2f4d1f584e29 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:53.474636 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7783c80d-a296-48cc-9de0-2f4d1f584e29 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:53.475416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7783c80d-a296-48cc-9de0-2f4d1f584e29 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:53.475885 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7783c80d-a296-48cc-9de0-2f4d1f584e29 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:53.490410 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-7783c80d-a296-48cc-9de0-2f4d1f584e29 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] HTTP exception thrown: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7783c80d-a296-48cc-9de0-2f4d1f584e29 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Request method failure captured: Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 HTTP/1.1 Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3YZj6DKjyQMLZmR_B9Bah4Q0ybWgsBvnIj_l43C4dq_R6huNfGIoe0S4w4R_l5yEs8j_DSsu3EklYnCGyZNQW6PhSeNwV7XMAGsksCxPp0WZmwpi7yB0Zqv9ZiSK-vbu8J847YLZi6wTfjraURxb8BsUx34WH4PwoSPEJg63l2d2g Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:53:53.492205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ef2947427ce24f46baad0172db285cc8", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 88b4bd52ede644f0aac8dff94e09dd7d Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:53.497510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': '18040578-a916-4929-ae00-067b0441f8e7'} Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:53.498702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:53.500401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:53.501906 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7783c80d-a296-48cc-9de0-2f4d1f584e29 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Returning 404 to user: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:53.501906 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7783c80d-a296-48cc-9de0-2f4d1f584e29 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 404 len: 111 microversion: 2.20 time: 0.032400 Jul 18 08:53:53.501906 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 446/899] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:53 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 08:53:53.504456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-578afe0a-e587-4547-8066-264444f4441d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '.version_select at 0x7fafb7084af0>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:53.639981 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-578afe0a-e587-4547-8066-264444f4441d tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145646988" status: 204 len: 0 microversion: 2.20 time: 0.139745 Jul 18 08:53:53.640692 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 454/900] 10.222.0.57 () {60 vars in 1261 bytes} [Mon Jul 18 08:53:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145646988 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 08:53:59.041897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0d96579c-9607-428f-ba3c-1e637b7bd1d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:59.042925 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0d96579c-9607-428f-ba3c-1e637b7bd1d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:59.052464 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0d96579c-9607-428f-ba3c-1e637b7bd1d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:59.053448 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0d96579c-9607-428f-ba3c-1e637b7bd1d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:59.054755 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0d96579c-9607-428f-ba3c-1e637b7bd1d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:59.055879 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0d96579c-9607-428f-ba3c-1e637b7bd1d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:59.070653 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-0d96579c-9607-428f-ba3c-1e637b7bd1d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] HTTP exception thrown: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0d96579c-9607-428f-ba3c-1e637b7bd1d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Request method failure captured: Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: DELETE /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 HTTP/1.1 Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3YZj6DKjyQMLZmR_B9Bah4Q0ybWgsBvnIj_l43C4dq_R6huNfGIoe0S4w4R_l5yEs8j_DSsu3EklYnCGyZNQW6PhSeNwV7XMAGsksCxPp0WZmwpi7yB0Zqv9ZiSK-vbu8J847YLZi6wTfjraURxb8BsUx34WH4PwoSPEJg63l2d2g Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:53:59.072716 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ef2947427ce24f46baad0172db285cc8", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 88b4bd52ede644f0aac8dff94e09dd7d Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:59.074215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': '18040578-a916-4929-ae00-067b0441f8e7'} Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:59.075050 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:59.076575 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:53:59.078028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0d96579c-9607-428f-ba3c-1e637b7bd1d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Returning 404 to user: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:59.078028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0d96579c-9607-428f-ba3c-1e637b7bd1d3 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "DELETE /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 404 len: 111 microversion: 2.20 time: 0.036179 Jul 18 08:53:59.078028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 447/901] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 08:53:59 2022] DELETE /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 08:53:59.083831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-db9dcc22-7bea-4f0a-8106-907643289609 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:53:59.084448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-db9dcc22-7bea-4f0a-8106-907643289609 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: 18040578-a916-4929-ae00-067b0441f8e7] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:53:59.091340 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-db9dcc22-7bea-4f0a-8106-907643289609 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:59.091943 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-db9dcc22-7bea-4f0a-8106-907643289609 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:59.092746 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-db9dcc22-7bea-4f0a-8106-907643289609 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:53:59.093191 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-db9dcc22-7bea-4f0a-8106-907643289609 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:53:59.107227 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-db9dcc22-7bea-4f0a-8106-907643289609 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] HTTP exception thrown: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-db9dcc22-7bea-4f0a-8106-907643289609 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Request method failure captured: Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 HTTP/1.1 Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3YZj6DKjyQMLZmR_B9Bah4Q0ybWgsBvnIj_l43C4dq_R6huNfGIoe0S4w4R_l5yEs8j_DSsu3EklYnCGyZNQW6PhSeNwV7XMAGsksCxPp0WZmwpi7yB0Zqv9ZiSK-vbu8J847YLZi6wTfjraURxb8BsUx34WH4PwoSPEJg63l2d2g Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:53:59.108944 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ef2947427ce24f46baad0172db285cc8", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 88b4bd52ede644f0aac8dff94e09dd7d Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:59.110552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '18040578-a916-4929-ae00-067b0441f8e7'} Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:53:59.115563 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. Jul 18 08:53:59.118544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:53:59.120088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-db9dcc22-7bea-4f0a-8106-907643289609 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Returning 404 to user: Instance 18040578-a916-4929-ae00-067b0441f8e7 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:53:59.120088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-db9dcc22-7bea-4f0a-8106-907643289609 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7" status: 404 len: 111 microversion: 2.20 time: 0.031131 Jul 18 08:53:59.120088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 455/902] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:53:59 2022] GET /compute/v2.1/servers/18040578-a916-4929-ae00-067b0441f8e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 08:54:00.439399 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9cc3e18f-56e6-4e1c-acfa-e75f2d2f55bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:00.439977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9cc3e18f-56e6-4e1c-acfa-e75f2d2f55bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:00.446492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9cc3e18f-56e6-4e1c-acfa-e75f2d2f55bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:00.446945 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9cc3e18f-56e6-4e1c-acfa-e75f2d2f55bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:00.447774 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9cc3e18f-56e6-4e1c-acfa-e75f2d2f55bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:00.448234 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9cc3e18f-56e6-4e1c-acfa-e75f2d2f55bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:00.463819 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-9cc3e18f-56e6-4e1c-acfa-e75f2d2f55bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] HTTP exception thrown: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9cc3e18f-56e6-4e1c-acfa-e75f2d2f55bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Request method failure captured: Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: DELETE /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e HTTP/1.1 Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R3YZj6DKjyQMLZmR_B9Bah4Q0ybWgsBvnIj_l43C4dq_R6huNfGIoe0S4w4R_l5yEs8j_DSsu3EklYnCGyZNQW6PhSeNwV7XMAGsksCxPp0WZmwpi7yB0Zqv9ZiSK-vbu8J847YLZi6wTfjraURxb8BsUx34WH4PwoSPEJg63l2d2g Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:54:00.465392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ef2947427ce24f46baad0172db285cc8", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 88b4bd52ede644f0aac8dff94e09dd7d Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:54:00.467461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'f3d6245b-0c6d-4a19-85c6-841d85912f2e'} Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:54:00.468278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:54:00.469621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:00.472012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9cc3e18f-56e6-4e1c-acfa-e75f2d2f55bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Returning 404 to user: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:54:00.472012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9cc3e18f-56e6-4e1c-acfa-e75f2d2f55bf tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 404 len: 111 microversion: 2.20 time: 0.032382 Jul 18 08:54:00.472012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 448/903] 10.222.0.57 () {60 vars in 1279 bytes} [Mon Jul 18 08:54:00 2022] DELETE /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 08:54:00.475806 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d6e981c2-f758-42d5-bab1-8cc19a74efc2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:00.476595 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d6e981c2-f758-42d5-bab1-8cc19a74efc2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] [instance: f3d6245b-0c6d-4a19-85c6-841d85912f2e] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:00.484229 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d6e981c2-f758-42d5-bab1-8cc19a74efc2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:00.484695 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d6e981c2-f758-42d5-bab1-8cc19a74efc2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:00.485617 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d6e981c2-f758-42d5-bab1-8cc19a74efc2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:00.486096 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d6e981c2-f758-42d5-bab1-8cc19a74efc2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:00.501263 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-d6e981c2-f758-42d5-bab1-8cc19a74efc2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] HTTP exception thrown: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d6e981c2-f758-42d5-bab1-8cc19a74efc2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Request method failure captured: Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e HTTP/1.1 Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R3YZj6DKjyQMLZmR_B9Bah4Q0ybWgsBvnIj_l43C4dq_R6huNfGIoe0S4w4R_l5yEs8j_DSsu3EklYnCGyZNQW6PhSeNwV7XMAGsksCxPp0WZmwpi7yB0Zqv9ZiSK-vbu8J847YLZi6wTfjraURxb8BsUx34WH4PwoSPEJg63l2d2g Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:54:00.502866 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef2947427ce24f46baad0172db285cc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ef2947427ce24f46baad0172db285cc8", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: ef2947427ce24f46baad0172db285cc8 Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-49965800 Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 88b4bd52ede644f0aac8dff94e09dd7d Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-AttachVolumeShelveTestJSON-49965800-project Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:54:00.504669 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': 'f3d6245b-0c6d-4a19-85c6-841d85912f2e'} Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:54:00.509393 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. Jul 18 08:54:00.510868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:54:00.512010 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d6e981c2-f758-42d5-bab1-8cc19a74efc2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] Returning 404 to user: Instance f3d6245b-0c6d-4a19-85c6-841d85912f2e could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:54:00.512010 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d6e981c2-f758-42d5-bab1-8cc19a74efc2 tempest-AttachVolumeShelveTestJSON-49965800 tempest-AttachVolumeShelveTestJSON-49965800-project] 10.222.0.57 "GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e" status: 404 len: 111 microversion: 2.20 time: 0.032353 Jul 18 08:54:00.512010 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 456/904] 10.222.0.57 () {60 vars in 1276 bytes} [Mon Jul 18 08:54:00 2022] GET /compute/v2.1/servers/f3d6245b-0c6d-4a19-85c6-841d85912f2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 08:54:02.345783 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1772642835", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "networks": [{"uuid": "abe51fc9-a347-458b-a8db-9e61dfd2258f"}]}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:54:02.414190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] validate_networks() for [('abe51fc9-a347-458b-a8db-9e61dfd2258f', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:54:03.330057 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:54:03.330545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:54:03.331023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:54:03.331442 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:54:03.331874 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:54:03.340999 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:03.341445 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:03.342236 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:03.342690 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:03.360366 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Getting quotas for project 401f21125b3146fe9deba3df1abf1803. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:54:03.364359 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Getting quotas for user 4e8cc08181c74bb584fdca44adba662a and project 401f21125b3146fe9deba3df1abf1803. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:54:03.376118 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:54:03.378356 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:54:03.613917 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7c77a1e4-7e63-4a39-aa0d-39f1ff9382fb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274153 Jul 18 08:54:03.615010 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 449/905] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:54:03.625609 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-00fab257-25a8-4dd2-a281-53f757d6d922 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:03.626233 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-00fab257-25a8-4dd2-a281-53f757d6d922 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:03.710254 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-00fab257-25a8-4dd2-a281-53f757d6d922 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:03.718909 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-00fab257-25a8-4dd2-a281-53f757d6d922 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1214 microversion: 2.1 time: 0.097468 Jul 18 08:54:03.719542 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 457/906] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:03 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:04.737273 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0fbf1fc2-d28f-42ca-9f9d-6552a0b011b8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:04.738054 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0fbf1fc2-d28f-42ca-9f9d-6552a0b011b8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:04.821222 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0fbf1fc2-d28f-42ca-9f9d-6552a0b011b8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:04.829077 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0fbf1fc2-d28f-42ca-9f9d-6552a0b011b8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1214 microversion: 2.1 time: 0.096350 Jul 18 08:54:04.829654 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 450/907] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:04 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:05.845877 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ce0aece3-2f4c-4a98-9dad-e90f187c2c06 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:05.846998 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ce0aece3-2f4c-4a98-9dad-e90f187c2c06 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:05.853948 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce0aece3-2f4c-4a98-9dad-e90f187c2c06 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:05.854395 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce0aece3-2f4c-4a98-9dad-e90f187c2c06 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:05.855173 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce0aece3-2f4c-4a98-9dad-e90f187c2c06 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:05.855852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce0aece3-2f4c-4a98-9dad-e90f187c2c06 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:05.926077 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ce0aece3-2f4c-4a98-9dad-e90f187c2c06 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:05.933877 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ce0aece3-2f4c-4a98-9dad-e90f187c2c06 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1210 microversion: 2.1 time: 0.092115 Jul 18 08:54:05.934446 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 458/908] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:05 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:06.959292 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a8e02863-a672-4ec3-abf0-39401809ce41 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:06.959292 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a8e02863-a672-4ec3-abf0-39401809ce41 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:06.965619 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a8e02863-a672-4ec3-abf0-39401809ce41 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:06.967168 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a8e02863-a672-4ec3-abf0-39401809ce41 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:06.969282 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a8e02863-a672-4ec3-abf0-39401809ce41 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:06.970348 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a8e02863-a672-4ec3-abf0-39401809ce41 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:07.073923 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d8120b8a-453e-4e6e-981d-91e88c74d472 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Action: 'create', calling method: .version_select at 0x7fafb7149550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1561420967"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:54:07.268570 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a8e02863-a672-4ec3-abf0-39401809ce41 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:07.276515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a8e02863-a672-4ec3-abf0-39401809ce41 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1284 microversion: 2.1 time: 0.329901 Jul 18 08:54:07.277259 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 459/909] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:06 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1284 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:08.056310 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d8120b8a-453e-4e6e-981d-91e88c74d472 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.178386 Jul 18 08:54:08.056310 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 451/910] 10.222.0.57 () {60 vars in 1154 bytes} [Mon Jul 18 08:54:06 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1180 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 08:54:08.067985 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-90d19250-b209-4638-a401-0f32c72163bd tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb7149430>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:08.123838 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-90d19250-b209-4638-a401-0f32c72163bd tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff" status: 200 len: 345 microversion: 2.1 time: 0.059873 Jul 18 08:54:08.124650 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 460/911] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:54:08 2022] GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:08.299574 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e2761726-b117-4f51-b56e-5d85aa547095 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:08.307712 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e2761726-b117-4f51-b56e-5d85aa547095 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:08.315726 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e2761726-b117-4f51-b56e-5d85aa547095 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:08.316595 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e2761726-b117-4f51-b56e-5d85aa547095 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:08.317894 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e2761726-b117-4f51-b56e-5d85aa547095 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:08.318778 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e2761726-b117-4f51-b56e-5d85aa547095 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:08.498552 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e2761726-b117-4f51-b56e-5d85aa547095 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:08.508028 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e2761726-b117-4f51-b56e-5d85aa547095 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1314 microversion: 2.1 time: 0.217711 Jul 18 08:54:08.509448 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 452/912] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:08 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:09.125591 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-6c29134d-1e7e-4d19-b542-8ea0857dc9fb req-49d28a07-f4bc-4c26-80eb-076db6a9815b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f150986f-1d8a-4303-a28c-9701099cc814", "tag": "6c10375f-c021-41fb-9dba-54f90f90c859"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:54:09.136624 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-6c29134d-1e7e-4d19-b542-8ea0857dc9fb req-49d28a07-f4bc-4c26-80eb-076db6a9815b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:09.138404 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-6c29134d-1e7e-4d19-b542-8ea0857dc9fb req-49d28a07-f4bc-4c26-80eb-076db6a9815b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:09.138669 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1676cd11-c902-42cb-8cb1-ccfc71908ece tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb71efe50>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:09.148800 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-6c29134d-1e7e-4d19-b542-8ea0857dc9fb req-49d28a07-f4bc-4c26-80eb-076db6a9815b service nova] Creating event network-changed:6c10375f-c021-41fb-9dba-54f90f90c859 for instance f150986f-1d8a-4303-a28c-9701099cc814 on hv-cinder-85014 Jul 18 08:54:09.154387 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-6c29134d-1e7e-4d19-b542-8ea0857dc9fb req-49d28a07-f4bc-4c26-80eb-076db6a9815b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033658 Jul 18 08:54:09.155474 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 461/913] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:09.191612 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1676cd11-c902-42cb-8cb1-ccfc71908ece tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff" status: 200 len: 346 microversion: 2.1 time: 0.056961 Jul 18 08:54:09.192220 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 453/914] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:54:09 2022] GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:54:09.205435 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-86794ede-3b5f-4f44-aca1-f7057a45667e tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Action: 'create', calling method: .version_select at 0x7fafb70e5790>, body: {"snapshot": {"volume_id": "a7f21ac3-8e21-4681-9c1e-7d1a26b505ff", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-679839973"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:54:09.527793 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9a59d180-c294-4e5b-9a56-94a161938ac0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:09.529131 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9a59d180-c294-4e5b-9a56-94a161938ac0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:09.537458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9a59d180-c294-4e5b-9a56-94a161938ac0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:09.538146 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9a59d180-c294-4e5b-9a56-94a161938ac0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:09.538933 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9a59d180-c294-4e5b-9a56-94a161938ac0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:09.539374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9a59d180-c294-4e5b-9a56-94a161938ac0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:09.697860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9a59d180-c294-4e5b-9a56-94a161938ac0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:09.713465 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9a59d180-c294-4e5b-9a56-94a161938ac0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1314 microversion: 2.1 time: 0.190065 Jul 18 08:54:09.714048 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 454/915] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:09 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:09.738191 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-86794ede-3b5f-4f44-aca1-f7057a45667e tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.535755 Jul 18 08:54:09.738191 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 462/916] 10.222.0.57 () {60 vars in 1161 bytes} [Mon Jul 18 08:54:09 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:09.747837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7bfa5b31-61a5-45f6-9502-14aec018913e tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb7166dc0>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:09.778969 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7bfa5b31-61a5-45f6-9502-14aec018913e tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2" status: 200 len: 286 microversion: 2.1 time: 0.035726 Jul 18 08:54:09.779543 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 455/917] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 08:54:09 2022] GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:54:09.792107 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b3d98b1b-a88d-4098-8d90-19e7365e751b tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb7149ca0>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:09.826013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b3d98b1b-a88d-4098-8d90-19e7365e751b tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038574 Jul 18 08:54:09.826013 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 463/918] 10.222.0.57 () {58 vars in 1139 bytes} [Mon Jul 18 08:54:09 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:09.835774 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0e5d3757-b0b5-4396-9a90-03a9de6d3dd0 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb713ba60>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:09.866707 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0e5d3757-b0b5-4396-9a90-03a9de6d3dd0 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2" status: 200 len: 286 microversion: 2.1 time: 0.034681 Jul 18 08:54:09.867269 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 456/919] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 08:54:09 2022] GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:10.731692 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1adc05b8-b043-4683-b7e2-dc6e97aa4002 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:10.733326 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1adc05b8-b043-4683-b7e2-dc6e97aa4002 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:10.740505 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1adc05b8-b043-4683-b7e2-dc6e97aa4002 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:10.740958 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1adc05b8-b043-4683-b7e2-dc6e97aa4002 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:10.741741 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1adc05b8-b043-4683-b7e2-dc6e97aa4002 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:10.742177 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1adc05b8-b043-4683-b7e2-dc6e97aa4002 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:10.880146 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-723caad4-862b-4b31-bf65-762d0bceea39 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafbfb47160>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:10.905193 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1adc05b8-b043-4683-b7e2-dc6e97aa4002 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:10.913174 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1adc05b8-b043-4683-b7e2-dc6e97aa4002 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1314 microversion: 2.1 time: 0.186226 Jul 18 08:54:10.913584 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-723caad4-862b-4b31-bf65-762d0bceea39 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2" status: 200 len: 286 microversion: 2.1 time: 0.037845 Jul 18 08:54:10.915698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 464/920] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:10 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:10.915909 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 457/921] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 08:54:10 2022] GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:54:11.926283 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3e3c8880-d4a3-4e69-815e-90b210b76a80 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb7090310>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:11.930980 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-dd4d121e-7941-486e-b2e8-9734cf1cc9bb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:11.932380 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-dd4d121e-7941-486e-b2e8-9734cf1cc9bb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:11.939224 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd4d121e-7941-486e-b2e8-9734cf1cc9bb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:11.939694 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd4d121e-7941-486e-b2e8-9734cf1cc9bb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:11.940470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd4d121e-7941-486e-b2e8-9734cf1cc9bb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:11.940896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dd4d121e-7941-486e-b2e8-9734cf1cc9bb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:11.960734 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-3e3c8880-d4a3-4e69-815e-90b210b76a80 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2" status: 200 len: 286 microversion: 2.1 time: 0.038343 Jul 18 08:54:11.961566 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 465/922] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 08:54:11 2022] GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:12.078615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-dd4d121e-7941-486e-b2e8-9734cf1cc9bb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:12.086598 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-dd4d121e-7941-486e-b2e8-9734cf1cc9bb tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1314 microversion: 2.1 time: 0.159909 Jul 18 08:54:12.087190 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 458/923] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:11 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:12.973808 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-824397b6-f53d-49aa-9369-c2e3715ad8d6 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb7149160>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:13.005084 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-824397b6-f53d-49aa-9369-c2e3715ad8d6 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2" status: 200 len: 287 microversion: 2.1 time: 0.035450 Jul 18 08:54:13.005084 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 466/924] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 08:54:12 2022] GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:13.016049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d2c5ebe6-0c22-4ed8-b6d6-4175a451813c tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb717c550>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:13.104130 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-45bfdce4-a252-4e6d-8204-34470a0ce640 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:13.104752 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-45bfdce4-a252-4e6d-8204-34470a0ce640 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:13.113524 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-45bfdce4-a252-4e6d-8204-34470a0ce640 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:13.113983 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-45bfdce4-a252-4e6d-8204-34470a0ce640 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:13.114782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-45bfdce4-a252-4e6d-8204-34470a0ce640 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:13.115356 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-45bfdce4-a252-4e6d-8204-34470a0ce640 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:13.176415 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d2c5ebe6-0c22-4ed8-b6d6-4175a451813c tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2" status: 202 len: 0 microversion: 2.1 time: 0.164473 Jul 18 08:54:13.177501 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 459/925] 10.222.0.57 () {58 vars in 1253 bytes} [Mon Jul 18 08:54:13 2022] DELETE /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:54:13.193130 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-91df0df1-5705-4e78-9205-93b1e67e6682 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb7137d30>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:13.244841 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-91df0df1-5705-4e78-9205-93b1e67e6682 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2" status: 200 len: 286 microversion: 2.1 time: 0.060419 Jul 18 08:54:13.246102 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 460/926] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 08:54:13 2022] GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:54:13.298225 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-45bfdce4-a252-4e6d-8204-34470a0ce640 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:13.306011 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-45bfdce4-a252-4e6d-8204-34470a0ce640 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1314 microversion: 2.1 time: 0.205728 Jul 18 08:54:13.308640 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 467/927] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:13 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:54:14.255463 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:14.259911 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a9dd8650-f597-42d3-9ff4-4c5bc31ee71a tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb71bd550>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:14.286466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-a9dd8650-f597-42d3-9ff4-4c5bc31ee71a tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] HTTP exception thrown: Snapshot d90967fc-f323-4c36-8bb2-df0da9390fc2 could not be found. Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a9dd8650-f597-42d3-9ff4-4c5bc31ee71a tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Request method failure captured: Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2 HTTP/1.1 Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R-uXAWhrBsvTrsRZU-2AeHCV5KNaQeBcfYsyd8qLlC0Lk0wlUy0m5t_rQkFElB7YaKdqtXmgNkHI60SRolfSiahKJmV2M7iMp0vQ6nofgugwK6nUBra1n9jNTeuk31Y22tNkn3r3pMGOAkBmDbnB9_2uHI0x8NvRlNj9jTfd4ROS6o Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: 690633edfd1847cf9ca6726401bfc53c Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:54:14.288771 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_690633edfd1847cf9ca6726401bfc53c", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: 690633edfd1847cf9ca6726401bfc53c Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-VolumesSnapshotsTestJSON-1605119670-project Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 56a5a8e24609483da8553b88efe97940 Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1605119670-project Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Snapshot d90967fc-f323-4c36-8bb2-df0da9390fc2 could not be found. Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'd90967fc-f323-4c36-8bb2-df0da9390fc2'} Jul 18 08:54:14.290485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d90967fc-f323-4c36-8bb2-df0da9390fc2 could not be found. (HTTP 404) (Request-ID: req-b7962d9b-8b3d-49e8-9b36-3137956941ef) Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:14.291484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 08:54:14.292837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d90967fc-f323-4c36-8bb2-df0da9390fc2 could not be found. Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 08:54:14.294049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d90967fc-f323-4c36-8bb2-df0da9390fc2 could not be found. Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d90967fc-f323-4c36-8bb2-df0da9390fc2 could not be found. Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a9dd8650-f597-42d3-9ff4-4c5bc31ee71a tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Returning 404 to user: Snapshot d90967fc-f323-4c36-8bb2-df0da9390fc2 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:54:14.295422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a9dd8650-f597-42d3-9ff4-4c5bc31ee71a tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2" status: 404 len: 111 microversion: 2.1 time: 0.035616 Jul 18 08:54:14.296467 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 461/928] 10.222.0.57 () {58 vars in 1250 bytes} [Mon Jul 18 08:54:14 2022] GET /compute/v2.1/os-snapshots/d90967fc-f323-4c36-8bb2-df0da9390fc2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:54:14.301662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9c530417-7da0-468c-a4ac-937e4035a006 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb7090b80>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:14.307988 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:14.335317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-7143b77a-e45d-4976-be83-524b4aab7720 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:14.335317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-7143b77a-e45d-4976-be83-524b4aab7720 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:14.343357 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7143b77a-e45d-4976-be83-524b4aab7720 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:14.343833 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7143b77a-e45d-4976-be83-524b4aab7720 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:14.344614 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7143b77a-e45d-4976-be83-524b4aab7720 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:14.345054 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-7143b77a-e45d-4976-be83-524b4aab7720 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:14.507492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-7143b77a-e45d-4976-be83-524b4aab7720 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:14.516756 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-7143b77a-e45d-4976-be83-524b4aab7720 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1314 microversion: 2.1 time: 0.188874 Jul 18 08:54:14.517392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 462/929] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:14 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:14.533153 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9c530417-7da0-468c-a4ac-937e4035a006 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff" status: 202 len: 0 microversion: 2.1 time: 0.235264 Jul 18 08:54:14.534356 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 468/930] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 08:54:14 2022] DELETE /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:54:14.542183 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3f525360-1986-4b5b-afd8-86511743d3de tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb7149d30>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:14.594810 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3f525360-1986-4b5b-afd8-86511743d3de tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff" status: 200 len: 345 microversion: 2.1 time: 0.056302 Jul 18 08:54:14.595399 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 463/931] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:54:14 2022] GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:15.534281 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ba0e86fe-069c-49c7-8a94-60210ea48315 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:15.534978 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ba0e86fe-069c-49c7-8a94-60210ea48315 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:15.542144 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba0e86fe-069c-49c7-8a94-60210ea48315 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:15.542592 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba0e86fe-069c-49c7-8a94-60210ea48315 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:15.543381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba0e86fe-069c-49c7-8a94-60210ea48315 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:15.543893 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ba0e86fe-069c-49c7-8a94-60210ea48315 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:15.606493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=8 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:15.616334 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b7aec95f-802a-4064-83a0-918ca23fa55c tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb72df5e0>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:15.670246 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-b7aec95f-802a-4064-83a0-918ca23fa55c tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] HTTP exception thrown: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b7aec95f-802a-4064-83a0-918ca23fa55c tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Request method failure captured: Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff HTTP/1.1 Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R-uXAWhrBsvTrsRZU-2AeHCV5KNaQeBcfYsyd8qLlC0Lk0wlUy0m5t_rQkFElB7YaKdqtXmgNkHI60SRolfSiahKJmV2M7iMp0vQ6nofgugwK6nUBra1n9jNTeuk31Y22tNkn3r3pMGOAkBmDbnB9_2uHI0x8NvRlNj9jTfd4ROS6o Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: 690633edfd1847cf9ca6726401bfc53c Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:54:15.673492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_690633edfd1847cf9ca6726401bfc53c", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: 690633edfd1847cf9ca6726401bfc53c Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-VolumesSnapshotsTestJSON-1605119670-project Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 56a5a8e24609483da8553b88efe97940 Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1605119670-project Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'a7f21ac3-8e21-4681-9c1e-7d1a26b505ff'} Jul 18 08:54:15.676673 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. (HTTP 404) (Request-ID: req-8ba48917-efa1-4f5f-b7d0-36701dbb1fef) Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:15.679170 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 08:54:15.683994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 08:54:15.689984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b7aec95f-802a-4064-83a0-918ca23fa55c tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Returning 404 to user: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b7aec95f-802a-4064-83a0-918ca23fa55c tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff" status: 404 len: 109 microversion: 2.1 time: 0.070930 Jul 18 08:54:15.693578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 464/932] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:54:15 2022] GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:54:15.713202 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-79c13ded-d111-467c-b740-e270234ca73d tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb717c3a0>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:15.745007 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-79c13ded-d111-467c-b740-e270234ca73d tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] HTTP exception thrown: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-79c13ded-d111-467c-b740-e270234ca73d tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Request method failure captured: Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: DELETE /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff HTTP/1.1 Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R-uXAWhrBsvTrsRZU-2AeHCV5KNaQeBcfYsyd8qLlC0Lk0wlUy0m5t_rQkFElB7YaKdqtXmgNkHI60SRolfSiahKJmV2M7iMp0vQ6nofgugwK6nUBra1n9jNTeuk31Y22tNkn3r3pMGOAkBmDbnB9_2uHI0x8NvRlNj9jTfd4ROS6o Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: 690633edfd1847cf9ca6726401bfc53c Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:54:15.746954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_690633edfd1847cf9ca6726401bfc53c", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: 690633edfd1847cf9ca6726401bfc53c Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-VolumesSnapshotsTestJSON-1605119670-project Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 56a5a8e24609483da8553b88efe97940 Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1605119670-project Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'a7f21ac3-8e21-4681-9c1e-7d1a26b505ff'} Jul 18 08:54:15.748972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. (HTTP 404) (Request-ID: req-d27e75f0-52c3-4049-8c95-77aa1f5749ed) Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:15.750000 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 08:54:15.751377 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 08:54:15.752977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-79c13ded-d111-467c-b740-e270234ca73d tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Returning 404 to user: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:54:15.754709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-79c13ded-d111-467c-b740-e270234ca73d tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff" status: 404 len: 109 microversion: 2.1 time: 0.044990 Jul 18 08:54:15.756159 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ba0e86fe-069c-49c7-8a94-60210ea48315 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:15.756529 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 465/933] 10.222.0.57 () {58 vars in 1247 bytes} [Mon Jul 18 08:54:15 2022] DELETE /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:54:15.757836 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-27af59ac-8c2b-428e-8857-285c249c8027 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Calling method '.version_select at 0x7fafb71bdb80>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:15.764281 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ba0e86fe-069c-49c7-8a94-60210ea48315 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1314 microversion: 2.1 time: 0.234194 Jul 18 08:54:15.767198 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 469/934] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:15 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:15.797276 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-27af59ac-8c2b-428e-8857-285c249c8027 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] HTTP exception thrown: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-27af59ac-8c2b-428e-8857-285c249c8027 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Request method failure captured: Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff HTTP/1.1 Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R-uXAWhrBsvTrsRZU-2AeHCV5KNaQeBcfYsyd8qLlC0Lk0wlUy0m5t_rQkFElB7YaKdqtXmgNkHI60SRolfSiahKJmV2M7iMp0vQ6nofgugwK6nUBra1n9jNTeuk31Y22tNkn3r3pMGOAkBmDbnB9_2uHI0x8NvRlNj9jTfd4ROS6o Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: 690633edfd1847cf9ca6726401bfc53c Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:54:15.800017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/690633edfd1847cf9ca6726401bfc53c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_690633edfd1847cf9ca6726401bfc53c", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: 690633edfd1847cf9ca6726401bfc53c Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1605119670 Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-VolumesSnapshotsTestJSON-1605119670-project Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 56a5a8e24609483da8553b88efe97940 Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1605119670-project Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'a7f21ac3-8e21-4681-9c1e-7d1a26b505ff'} Jul 18 08:54:15.801466 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. (HTTP 404) (Request-ID: req-566a96f6-113a-4c50-8683-f390509ce929) Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:15.802406 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 08:54:15.803708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 08:54:15.805340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-27af59ac-8c2b-428e-8857-285c249c8027 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] Returning 404 to user: Volume a7f21ac3-8e21-4681-9c1e-7d1a26b505ff could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-27af59ac-8c2b-428e-8857-285c249c8027 tempest-VolumesSnapshotsTestJSON-1605119670 tempest-VolumesSnapshotsTestJSON-1605119670-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff" status: 404 len: 109 microversion: 2.1 time: 0.047292 Jul 18 08:54:15.806827 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 466/935] 10.222.0.57 () {58 vars in 1244 bytes} [Mon Jul 18 08:54:15 2022] GET /compute/v2.1/os-volumes/a7f21ac3-8e21-4681-9c1e-7d1a26b505ff => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:54:16.794596 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-4ff638e9-8789-4345-8c30-1664e3c41a8c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:16.798607 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-4ff638e9-8789-4345-8c30-1664e3c41a8c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:16.802895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4ff638e9-8789-4345-8c30-1664e3c41a8c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:16.803356 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4ff638e9-8789-4345-8c30-1664e3c41a8c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:16.804376 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4ff638e9-8789-4345-8c30-1664e3c41a8c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:16.804731 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-4ff638e9-8789-4345-8c30-1664e3c41a8c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:17.014741 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-4ff638e9-8789-4345-8c30-1664e3c41a8c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:17.022651 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-4ff638e9-8789-4345-8c30-1664e3c41a8c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1314 microversion: 2.1 time: 0.233127 Jul 18 08:54:17.023322 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 470/936] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:16 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:17.567325 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-89f6f73d-45d2-448c-bca8-ab7301770a9e req-0583ee18-83e0-42e8-bd3b-046a3670701f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f150986f-1d8a-4303-a28c-9701099cc814", "name": "network-vif-plugged", "status": "completed", "tag": "6c10375f-c021-41fb-9dba-54f90f90c859"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:54:17.579718 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-89f6f73d-45d2-448c-bca8-ab7301770a9e req-0583ee18-83e0-42e8-bd3b-046a3670701f service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:17.580304 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-89f6f73d-45d2-448c-bca8-ab7301770a9e req-0583ee18-83e0-42e8-bd3b-046a3670701f service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:17.592774 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-89f6f73d-45d2-448c-bca8-ab7301770a9e req-0583ee18-83e0-42e8-bd3b-046a3670701f service nova] Creating event network-vif-plugged:6c10375f-c021-41fb-9dba-54f90f90c859 for instance f150986f-1d8a-4303-a28c-9701099cc814 on hv-cinder-85014 Jul 18 08:54:17.598562 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-89f6f73d-45d2-448c-bca8-ab7301770a9e req-0583ee18-83e0-42e8-bd3b-046a3670701f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036313 Jul 18 08:54:17.604370 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 467/937] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:18.047315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2aae0ddb-4171-4f6b-b596-ef2c4252ba65 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:18.048232 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-2aae0ddb-4171-4f6b-b596-ef2c4252ba65 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:18.055694 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2aae0ddb-4171-4f6b-b596-ef2c4252ba65 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:18.056259 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2aae0ddb-4171-4f6b-b596-ef2c4252ba65 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:18.057138 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2aae0ddb-4171-4f6b-b596-ef2c4252ba65 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:18.057662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2aae0ddb-4171-4f6b-b596-ef2c4252ba65 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:18.293911 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2aae0ddb-4171-4f6b-b596-ef2c4252ba65 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:18.303874 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2aae0ddb-4171-4f6b-b596-ef2c4252ba65 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1314 microversion: 2.1 time: 0.265427 Jul 18 08:54:18.304569 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 471/938] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:18 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:19.323287 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0ad92cd2-3912-451c-b010-9b4ba68aa3c8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:19.324137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0ad92cd2-3912-451c-b010-9b4ba68aa3c8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:19.332536 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ad92cd2-3912-451c-b010-9b4ba68aa3c8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:19.336062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ad92cd2-3912-451c-b010-9b4ba68aa3c8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:19.336062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ad92cd2-3912-451c-b010-9b4ba68aa3c8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:19.336062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ad92cd2-3912-451c-b010-9b4ba68aa3c8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:19.516239 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0ad92cd2-3912-451c-b010-9b4ba68aa3c8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:19.532525 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0ad92cd2-3912-451c-b010-9b4ba68aa3c8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1314 microversion: 2.1 time: 0.213534 Jul 18 08:54:19.533522 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 468/939] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:19 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:20.553659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-73fe4c35-9e57-42d8-b54b-fbfdfd1891a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:20.554735 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-73fe4c35-9e57-42d8-b54b-fbfdfd1891a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:20.558837 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:20.564262 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-73fe4c35-9e57-42d8-b54b-fbfdfd1891a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:20.564802 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-73fe4c35-9e57-42d8-b54b-fbfdfd1891a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:20.566316 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-73fe4c35-9e57-42d8-b54b-fbfdfd1891a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:20.566937 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-73fe4c35-9e57-42d8-b54b-fbfdfd1891a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:20.574048 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:20.761061 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-73fe4c35-9e57-42d8-b54b-fbfdfd1891a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:20.769748 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-73fe4c35-9e57-42d8-b54b-fbfdfd1891a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1499 microversion: 2.1 time: 0.223158 Jul 18 08:54:20.770339 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 472/940] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:20 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1499 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:21.643805 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e9390cb5-b0c0-409d-bccb-bb45239dc0ac tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:21.644425 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e9390cb5-b0c0-409d-bccb-bb45239dc0ac tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:21.647039 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:21.652274 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9390cb5-b0c0-409d-bccb-bb45239dc0ac tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:21.652725 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9390cb5-b0c0-409d-bccb-bb45239dc0ac tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:21.653708 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9390cb5-b0c0-409d-bccb-bb45239dc0ac tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:21.654222 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9390cb5-b0c0-409d-bccb-bb45239dc0ac tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:21.658952 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=55 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:21.690434 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e9390cb5-b0c0-409d-bccb-bb45239dc0ac tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Going to try to terminate instance {{(pid=124895) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:54:22.077845 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e9390cb5-b0c0-409d-bccb-bb45239dc0ac tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 204 len: 0 microversion: 2.1 time: 0.437914 Jul 18 08:54:22.078553 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 469/941] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:54:21 2022] DELETE /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 08:54:22.097701 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-13f4e354-bd86-454a-b8b2-7cb75387e46b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:22.098461 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-13f4e354-bd86-454a-b8b2-7cb75387e46b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:22.106349 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-13f4e354-bd86-454a-b8b2-7cb75387e46b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:22.106705 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-13f4e354-bd86-454a-b8b2-7cb75387e46b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:22.108033 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-13f4e354-bd86-454a-b8b2-7cb75387e46b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:22.108552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-13f4e354-bd86-454a-b8b2-7cb75387e46b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:22.260708 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-13f4e354-bd86-454a-b8b2-7cb75387e46b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:22.268494 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-13f4e354-bd86-454a-b8b2-7cb75387e46b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1505 microversion: 2.1 time: 0.175021 Jul 18 08:54:22.269074 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 473/942] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:22 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:23.287702 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c1f5a569-ead3-4bb0-8ea2-507864614575 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:23.288615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c1f5a569-ead3-4bb0-8ea2-507864614575 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:23.297662 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1f5a569-ead3-4bb0-8ea2-507864614575 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:23.298255 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1f5a569-ead3-4bb0-8ea2-507864614575 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:23.299350 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1f5a569-ead3-4bb0-8ea2-507864614575 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:23.300054 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1f5a569-ead3-4bb0-8ea2-507864614575 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:23.471633 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-c1f5a569-ead3-4bb0-8ea2-507864614575 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:23.479625 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c1f5a569-ead3-4bb0-8ea2-507864614575 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1505 microversion: 2.1 time: 0.196918 Jul 18 08:54:23.480267 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 470/943] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:23 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:24.183230 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-1d77d1c4-7a03-4245-8c1c-84540a572d9c req-469cce6c-d077-4bf0-8b3a-8fbb8c01f570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f150986f-1d8a-4303-a28c-9701099cc814", "name": "network-vif-deleted", "tag": "6c10375f-c021-41fb-9dba-54f90f90c859"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:54:24.196023 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-1d77d1c4-7a03-4245-8c1c-84540a572d9c req-469cce6c-d077-4bf0-8b3a-8fbb8c01f570 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:24.196795 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-1d77d1c4-7a03-4245-8c1c-84540a572d9c req-469cce6c-d077-4bf0-8b3a-8fbb8c01f570 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:24.212271 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-1d77d1c4-7a03-4245-8c1c-84540a572d9c req-469cce6c-d077-4bf0-8b3a-8fbb8c01f570 service nova] Creating event network-vif-deleted:6c10375f-c021-41fb-9dba-54f90f90c859 for instance f150986f-1d8a-4303-a28c-9701099cc814 on hv-cinder-85014 Jul 18 08:54:24.220500 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-1d77d1c4-7a03-4245-8c1c-84540a572d9c req-469cce6c-d077-4bf0-8b3a-8fbb8c01f570 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044054 Jul 18 08:54:24.221418 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 474/944] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:24.504719 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-83f906b5-b804-4472-acfc-c5f36dfe484b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:24.505454 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-83f906b5-b804-4472-acfc-c5f36dfe484b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:24.514322 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-83f906b5-b804-4472-acfc-c5f36dfe484b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:24.515463 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-83f906b5-b804-4472-acfc-c5f36dfe484b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:24.516471 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-83f906b5-b804-4472-acfc-c5f36dfe484b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:24.516915 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-83f906b5-b804-4472-acfc-c5f36dfe484b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:24.610911 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-83f906b5-b804-4472-acfc-c5f36dfe484b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:24.629537 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-83f906b5-b804-4472-acfc-c5f36dfe484b tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 200 len: 1299 microversion: 2.1 time: 0.127225 Jul 18 08:54:24.629537 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 471/945] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:24 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:25.659717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f1bb7e36-3d16-4426-8e78-985a1ebb2fd5 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:25.661279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f1bb7e36-3d16-4426-8e78-985a1ebb2fd5 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: f150986f-1d8a-4303-a28c-9701099cc814] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:25.672490 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f1bb7e36-3d16-4426-8e78-985a1ebb2fd5 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:25.673313 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f1bb7e36-3d16-4426-8e78-985a1ebb2fd5 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:25.690952 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f1bb7e36-3d16-4426-8e78-985a1ebb2fd5 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:25.690952 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f1bb7e36-3d16-4426-8e78-985a1ebb2fd5 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:25.692356 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-f1bb7e36-3d16-4426-8e78-985a1ebb2fd5 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] HTTP exception thrown: Instance f150986f-1d8a-4303-a28c-9701099cc814 could not be found. Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f1bb7e36-3d16-4426-8e78-985a1ebb2fd5 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Request method failure captured: Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 HTTP/1.1 Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R-oWGOIHrCPwQdCGU-pZ9AVC9d4TBWljs3QHiwMs69TR0j1NK_MN-x72YOUv7gV8E9D6elb639f0e5weizVBNf0UTOXVtlYcSW9mnCZbSfZStnvfhmf0KGDcbKEm_C7bf-e8DrINyxT-Xlv02bFrxctOGZTnzt7ZbrPaqrgWTCrsKU Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: 401f21125b3146fe9deba3df1abf1803 Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-VolumesActionsTest-1290209558 Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:54:25.694414 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/401f21125b3146fe9deba3df1abf1803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/401f21125b3146fe9deba3df1abf1803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/401f21125b3146fe9deba3df1abf1803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_401f21125b3146fe9deba3df1abf1803", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-VolumesActionsTest-1290209558 Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: 401f21125b3146fe9deba3df1abf1803 Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-VolumesActionsTest-1290209558 Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-VolumesActionsTest-1290209558-project Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 4e8cc08181c74bb584fdca44adba662a Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-VolumesActionsTest-1290209558-project Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance f150986f-1d8a-4303-a28c-9701099cc814 could not be found. Jul 18 08:54:25.696698 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': 'f150986f-1d8a-4303-a28c-9701099cc814'} Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f150986f-1d8a-4303-a28c-9701099cc814 could not be found. Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:54:25.697662 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f150986f-1d8a-4303-a28c-9701099cc814 could not be found. Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f150986f-1d8a-4303-a28c-9701099cc814 could not be found. Jul 18 08:54:25.699343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:54:25.701962 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f1bb7e36-3d16-4426-8e78-985a1ebb2fd5 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Returning 404 to user: Instance f150986f-1d8a-4303-a28c-9701099cc814 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:54:25.701962 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f1bb7e36-3d16-4426-8e78-985a1ebb2fd5 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814" status: 404 len: 111 microversion: 2.1 time: 0.047655 Jul 18 08:54:25.701962 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 475/946] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:25 2022] GET /compute/v2.1/servers/f150986f-1d8a-4303-a28c-9701099cc814 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:54:25.833391 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2030112921", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "networks": [{"uuid": "abe51fc9-a347-458b-a8db-9e61dfd2258f"}]}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:54:25.897604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] validate_networks() for [('abe51fc9-a347-458b-a8db-9e61dfd2258f', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:54:26.317308 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:54:26.317559 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:54:26.318184 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:54:26.318798 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:54:26.319232 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:54:26.336133 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:26.336133 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:26.336133 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:26.336133 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:26.362204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Getting quotas for project 401f21125b3146fe9deba3df1abf1803. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:54:26.369992 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Getting quotas for user 4e8cc08181c74bb584fdca44adba662a and project 401f21125b3146fe9deba3df1abf1803. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:54:26.392394 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:54:26.395084 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:54:26.565055 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-880e2c86-077c-49e5-96d2-0bd795923aa0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737684 Jul 18 08:54:26.565929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 472/947] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:54:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 08:54:26.581016 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5e7bb2d9-c3c4-46e2-8e62-abc0bdd85d31 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:26.581645 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5e7bb2d9-c3c4-46e2-8e62-abc0bdd85d31 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:26.648629 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5e7bb2d9-c3c4-46e2-8e62-abc0bdd85d31 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:26.658502 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5e7bb2d9-c3c4-46e2-8e62-abc0bdd85d31 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1214 microversion: 2.1 time: 0.083261 Jul 18 08:54:26.659799 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 476/948] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:26 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:27.682691 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6c408049-3d12-4e5a-bcac-18ec365d21c6 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:27.683523 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-6c408049-3d12-4e5a-bcac-18ec365d21c6 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:27.692031 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6c408049-3d12-4e5a-bcac-18ec365d21c6 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:27.692567 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6c408049-3d12-4e5a-bcac-18ec365d21c6 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:27.693459 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6c408049-3d12-4e5a-bcac-18ec365d21c6 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:27.693968 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6c408049-3d12-4e5a-bcac-18ec365d21c6 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:27.788153 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-6c408049-3d12-4e5a-bcac-18ec365d21c6 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:27.801384 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-6c408049-3d12-4e5a-bcac-18ec365d21c6 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1218 microversion: 2.1 time: 0.122096 Jul 18 08:54:27.802680 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 473/949] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:27 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:28.824673 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8b9a0aea-5821-4780-8ae4-e92d381b1efd tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:28.826823 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8b9a0aea-5821-4780-8ae4-e92d381b1efd tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:28.837302 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b9a0aea-5821-4780-8ae4-e92d381b1efd tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:28.837772 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b9a0aea-5821-4780-8ae4-e92d381b1efd tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:28.843887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b9a0aea-5821-4780-8ae4-e92d381b1efd tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:28.843887 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b9a0aea-5821-4780-8ae4-e92d381b1efd tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:28.945247 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8b9a0aea-5821-4780-8ae4-e92d381b1efd tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:28.957407 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8b9a0aea-5821-4780-8ae4-e92d381b1efd tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1274 microversion: 2.1 time: 0.137642 Jul 18 08:54:28.958327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 477/950] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:28 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:29.983517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1a1d4990-f403-4f67-a4fa-4d2bafe82b3a tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:29.984451 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1a1d4990-f403-4f67-a4fa-4d2bafe82b3a tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:29.993133 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1a1d4990-f403-4f67-a4fa-4d2bafe82b3a tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:29.993666 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1a1d4990-f403-4f67-a4fa-4d2bafe82b3a tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:29.994756 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1a1d4990-f403-4f67-a4fa-4d2bafe82b3a tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:29.995451 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1a1d4990-f403-4f67-a4fa-4d2bafe82b3a tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:30.188846 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1a1d4990-f403-4f67-a4fa-4d2bafe82b3a tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:30.201557 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1a1d4990-f403-4f67-a4fa-4d2bafe82b3a tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1314 microversion: 2.1 time: 0.222056 Jul 18 08:54:30.202144 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 474/951] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:29 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:30.989449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-98560efb-5130-44a2-9b4f-17362ea085c5 req-647ef12c-7f5b-49f0-a3bc-79ccf659ebac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3a8b07-d821-446a-973d-0b71203ad7ed", "tag": "5c267d5e-4c31-4bac-bf1c-3beaaa1ff9b2"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:54:31.009830 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-98560efb-5130-44a2-9b4f-17362ea085c5 req-647ef12c-7f5b-49f0-a3bc-79ccf659ebac service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:31.011052 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-98560efb-5130-44a2-9b4f-17362ea085c5 req-647ef12c-7f5b-49f0-a3bc-79ccf659ebac service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:31.035525 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-98560efb-5130-44a2-9b4f-17362ea085c5 req-647ef12c-7f5b-49f0-a3bc-79ccf659ebac service nova] Creating event network-changed:5c267d5e-4c31-4bac-bf1c-3beaaa1ff9b2 for instance 4e3a8b07-d821-446a-973d-0b71203ad7ed on hv-cinder-85014 Jul 18 08:54:31.044746 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-98560efb-5130-44a2-9b4f-17362ea085c5 req-647ef12c-7f5b-49f0-a3bc-79ccf659ebac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065935 Jul 18 08:54:31.045765 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 478/952] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:31.221964 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f94001b2-2f40-4db8-86b7-c362222281ce tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:31.223137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f94001b2-2f40-4db8-86b7-c362222281ce tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:31.238714 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f94001b2-2f40-4db8-86b7-c362222281ce tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:31.239511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f94001b2-2f40-4db8-86b7-c362222281ce tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:31.243604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f94001b2-2f40-4db8-86b7-c362222281ce tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:31.243604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f94001b2-2f40-4db8-86b7-c362222281ce tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:31.496879 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f94001b2-2f40-4db8-86b7-c362222281ce tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:31.518005 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f94001b2-2f40-4db8-86b7-c362222281ce tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1314 microversion: 2.1 time: 0.301816 Jul 18 08:54:31.519465 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 475/953] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:31 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:32.546448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ca741daf-1749-4ee5-b415-41e8515bb1c0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:32.547003 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ca741daf-1749-4ee5-b415-41e8515bb1c0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:32.556830 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ca741daf-1749-4ee5-b415-41e8515bb1c0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:32.557284 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ca741daf-1749-4ee5-b415-41e8515bb1c0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:32.558266 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ca741daf-1749-4ee5-b415-41e8515bb1c0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:32.558923 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ca741daf-1749-4ee5-b415-41e8515bb1c0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:32.781551 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ca741daf-1749-4ee5-b415-41e8515bb1c0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:32.793703 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ca741daf-1749-4ee5-b415-41e8515bb1c0 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1314 microversion: 2.1 time: 0.253569 Jul 18 08:54:32.794308 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 479/954] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:32 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:33.821475 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-99ec5901-d625-4d85-993c-df81666746a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:33.822824 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-99ec5901-d625-4d85-993c-df81666746a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:33.838851 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-99ec5901-d625-4d85-993c-df81666746a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:33.839608 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-99ec5901-d625-4d85-993c-df81666746a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:33.842161 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-99ec5901-d625-4d85-993c-df81666746a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:33.843165 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-99ec5901-d625-4d85-993c-df81666746a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:34.214751 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-99ec5901-d625-4d85-993c-df81666746a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:34.224618 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-99ec5901-d625-4d85-993c-df81666746a9 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1314 microversion: 2.1 time: 0.410959 Jul 18 08:54:34.225351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 476/955] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:33 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:35.249141 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bd104091-3972-4e8a-b357-28715ea35a52 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:35.253321 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bd104091-3972-4e8a-b357-28715ea35a52 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:35.256131 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd104091-3972-4e8a-b357-28715ea35a52 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:35.256584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd104091-3972-4e8a-b357-28715ea35a52 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:35.257391 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd104091-3972-4e8a-b357-28715ea35a52 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:35.257827 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd104091-3972-4e8a-b357-28715ea35a52 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:35.410067 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bd104091-3972-4e8a-b357-28715ea35a52 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:35.419920 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bd104091-3972-4e8a-b357-28715ea35a52 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1314 microversion: 2.1 time: 0.174378 Jul 18 08:54:35.420559 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 480/956] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:35 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:54:36.438457 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9e7c6a96-aee5-4329-8f2d-1d3f0bae3a75 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:36.439177 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9e7c6a96-aee5-4329-8f2d-1d3f0bae3a75 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:36.441788 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:36.446605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=6 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:36.447707 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9e7c6a96-aee5-4329-8f2d-1d3f0bae3a75 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:36.448179 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9e7c6a96-aee5-4329-8f2d-1d3f0bae3a75 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:36.448969 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9e7c6a96-aee5-4329-8f2d-1d3f0bae3a75 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:36.449411 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9e7c6a96-aee5-4329-8f2d-1d3f0bae3a75 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:36.718913 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9e7c6a96-aee5-4329-8f2d-1d3f0bae3a75 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:36.738936 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9e7c6a96-aee5-4329-8f2d-1d3f0bae3a75 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1314 microversion: 2.1 time: 0.304702 Jul 18 08:54:36.740540 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 477/957] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:36 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:37.667301 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-39dbd17a-d1be-4997-986c-edb1016ec3ae req-6e07033c-6658-40d5-a42e-671a28d8eae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3a8b07-d821-446a-973d-0b71203ad7ed", "name": "network-vif-plugged", "status": "completed", "tag": "5c267d5e-4c31-4bac-bf1c-3beaaa1ff9b2"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:54:37.678382 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:54:37.686785 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-39dbd17a-d1be-4997-986c-edb1016ec3ae req-6e07033c-6658-40d5-a42e-671a28d8eae5 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:37.687432 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-39dbd17a-d1be-4997-986c-edb1016ec3ae req-6e07033c-6658-40d5-a42e-671a28d8eae5 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:37.705843 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-39dbd17a-d1be-4997-986c-edb1016ec3ae req-6e07033c-6658-40d5-a42e-671a28d8eae5 service nova] Creating event network-vif-plugged:5c267d5e-4c31-4bac-bf1c-3beaaa1ff9b2 for instance 4e3a8b07-d821-446a-973d-0b71203ad7ed on hv-cinder-85014 Jul 18 08:54:37.712725 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-39dbd17a-d1be-4997-986c-edb1016ec3ae req-6e07033c-6658-40d5-a42e-671a28d8eae5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049329 Jul 18 08:54:37.713607 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 481/958] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:54:37.775349 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d2cedf2d-c619-463e-9be9-bf97d462d015 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:37.777267 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d2cedf2d-c619-463e-9be9-bf97d462d015 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:37.794484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2cedf2d-c619-463e-9be9-bf97d462d015 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:37.795746 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2cedf2d-c619-463e-9be9-bf97d462d015 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:37.797919 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2cedf2d-c619-463e-9be9-bf97d462d015 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:37.799316 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2cedf2d-c619-463e-9be9-bf97d462d015 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:37.999324 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d2cedf2d-c619-463e-9be9-bf97d462d015 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:38.007654 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d2cedf2d-c619-463e-9be9-bf97d462d015 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1314 microversion: 2.1 time: 0.243927 Jul 18 08:54:38.008259 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 478/959] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:37 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:39.029729 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a5bc693e-de58-4c5b-b9eb-e5df5fff1684 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:39.031284 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a5bc693e-de58-4c5b-b9eb-e5df5fff1684 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:39.038714 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a5bc693e-de58-4c5b-b9eb-e5df5fff1684 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:39.039182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a5bc693e-de58-4c5b-b9eb-e5df5fff1684 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:39.040158 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a5bc693e-de58-4c5b-b9eb-e5df5fff1684 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:39.040620 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a5bc693e-de58-4c5b-b9eb-e5df5fff1684 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:39.237109 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a5bc693e-de58-4c5b-b9eb-e5df5fff1684 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:39.250372 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a5bc693e-de58-4c5b-b9eb-e5df5fff1684 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1314 microversion: 2.1 time: 0.227169 Jul 18 08:54:39.267003 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 482/960] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:39 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:40.274959 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-879c1f21-2fd3-43ed-bf0d-62d057de4983 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:40.275401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-879c1f21-2fd3-43ed-bf0d-62d057de4983 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:40.284374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-879c1f21-2fd3-43ed-bf0d-62d057de4983 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:40.284838 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-879c1f21-2fd3-43ed-bf0d-62d057de4983 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:40.285670 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-879c1f21-2fd3-43ed-bf0d-62d057de4983 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:40.286345 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-879c1f21-2fd3-43ed-bf0d-62d057de4983 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:40.429810 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-879c1f21-2fd3-43ed-bf0d-62d057de4983 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:40.439033 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-879c1f21-2fd3-43ed-bf0d-62d057de4983 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1498 microversion: 2.1 time: 0.167031 Jul 18 08:54:40.439033 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 479/961] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:40 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:43.891857 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ec2d82f7-d893-42fe-83f5-fb2279d4ca22 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:43.892535 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ec2d82f7-d893-42fe-83f5-fb2279d4ca22 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:43.901272 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec2d82f7-d893-42fe-83f5-fb2279d4ca22 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:43.901541 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec2d82f7-d893-42fe-83f5-fb2279d4ca22 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:43.902578 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec2d82f7-d893-42fe-83f5-fb2279d4ca22 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:43.903019 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ec2d82f7-d893-42fe-83f5-fb2279d4ca22 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:43.937892 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ec2d82f7-d893-42fe-83f5-fb2279d4ca22 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:54:44.481616 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ec2d82f7-d893-42fe-83f5-fb2279d4ca22 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 204 len: 0 microversion: 2.1 time: 0.594121 Jul 18 08:54:44.482716 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 483/962] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:54:43 2022] DELETE /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:54:44.491492 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d443c5d4-f301-4191-a1ca-a37ef1ed5c4c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:44.492581 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d443c5d4-f301-4191-a1ca-a37ef1ed5c4c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:44.499606 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d443c5d4-f301-4191-a1ca-a37ef1ed5c4c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:44.500087 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d443c5d4-f301-4191-a1ca-a37ef1ed5c4c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:44.500970 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d443c5d4-f301-4191-a1ca-a37ef1ed5c4c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:44.501404 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d443c5d4-f301-4191-a1ca-a37ef1ed5c4c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:44.647359 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d443c5d4-f301-4191-a1ca-a37ef1ed5c4c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:44.655720 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d443c5d4-f301-4191-a1ca-a37ef1ed5c4c tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1504 microversion: 2.1 time: 0.167967 Jul 18 08:54:44.656672 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 480/963] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:44 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:45.674175 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6eee5334-7a95-4983-9be6-aec29f9db275 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:45.674855 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6eee5334-7a95-4983-9be6-aec29f9db275 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:45.681970 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6eee5334-7a95-4983-9be6-aec29f9db275 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:45.682430 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6eee5334-7a95-4983-9be6-aec29f9db275 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:45.683215 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6eee5334-7a95-4983-9be6-aec29f9db275 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:45.683657 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6eee5334-7a95-4983-9be6-aec29f9db275 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:45.839927 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-6eee5334-7a95-4983-9be6-aec29f9db275 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:45.851851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6eee5334-7a95-4983-9be6-aec29f9db275 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1504 microversion: 2.1 time: 0.182186 Jul 18 08:54:45.853059 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 484/964] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:45 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:46.578259 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-439d8c16-cac7-4987-a9eb-90cb8d792cb5 req-652a02a9-533d-40c9-acc7-be255e22c9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3a8b07-d821-446a-973d-0b71203ad7ed", "name": "network-vif-deleted", "tag": "5c267d5e-4c31-4bac-bf1c-3beaaa1ff9b2"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:54:46.590967 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-439d8c16-cac7-4987-a9eb-90cb8d792cb5 req-652a02a9-533d-40c9-acc7-be255e22c9b0 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:46.591797 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-439d8c16-cac7-4987-a9eb-90cb8d792cb5 req-652a02a9-533d-40c9-acc7-be255e22c9b0 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:46.612517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-439d8c16-cac7-4987-a9eb-90cb8d792cb5 req-652a02a9-533d-40c9-acc7-be255e22c9b0 service nova] Creating event network-vif-deleted:5c267d5e-4c31-4bac-bf1c-3beaaa1ff9b2 for instance 4e3a8b07-d821-446a-973d-0b71203ad7ed on hv-cinder-85014 Jul 18 08:54:46.617906 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-439d8c16-cac7-4987-a9eb-90cb8d792cb5 req-652a02a9-533d-40c9-acc7-be255e22c9b0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049927 Jul 18 08:54:46.618530 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 481/965] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:54:46.871217 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1bf0f48d-ed73-403b-b455-62587ee743e8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:46.872039 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1bf0f48d-ed73-403b-b455-62587ee743e8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:46.883400 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1bf0f48d-ed73-403b-b455-62587ee743e8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:46.883654 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1bf0f48d-ed73-403b-b455-62587ee743e8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:46.884465 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1bf0f48d-ed73-403b-b455-62587ee743e8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:46.884901 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1bf0f48d-ed73-403b-b455-62587ee743e8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:46.990008 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1bf0f48d-ed73-403b-b455-62587ee743e8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e8cc08181c74bb584fdca44adba662a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401f21125b3146fe9deba3df1abf1803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:54:47.004095 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1bf0f48d-ed73-403b-b455-62587ee743e8 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 200 len: 1299 microversion: 2.1 time: 0.136933 Jul 18 08:54:47.005119 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 485/966] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:46 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:54:48.038091 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a3610ec5-776e-4c18-98d4-a1133eb82a50 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:54:48.038091 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a3610ec5-776e-4c18-98d4-a1133eb82a50 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] [instance: 4e3a8b07-d821-446a-973d-0b71203ad7ed] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:54:48.050230 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a3610ec5-776e-4c18-98d4-a1133eb82a50 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:48.050835 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a3610ec5-776e-4c18-98d4-a1133eb82a50 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:48.051943 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a3610ec5-776e-4c18-98d4-a1133eb82a50 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:54:48.052550 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a3610ec5-776e-4c18-98d4-a1133eb82a50 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:54:48.073533 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-a3610ec5-776e-4c18-98d4-a1133eb82a50 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] HTTP exception thrown: Instance 4e3a8b07-d821-446a-973d-0b71203ad7ed could not be found. Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a3610ec5-776e-4c18-98d4-a1133eb82a50 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Request method failure captured: Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed HTTP/1.1 Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R-oWGOIHrCPwQdCGU-pZ9AVC9d4TBWljs3QHiwMs69TR0j1NK_MN-x72YOUv7gV8E9D6elb639f0e5weizVBNf0UTOXVtlYcSW9mnCZbSfZStnvfhmf0KGDcbKEm_C7bf-e8DrINyxT-Xlv02bFrxctOGZTnzt7ZbrPaqrgWTCrsKU Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: 401f21125b3146fe9deba3df1abf1803 Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-VolumesActionsTest-1290209558 Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:54:48.076248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/401f21125b3146fe9deba3df1abf1803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/401f21125b3146fe9deba3df1abf1803"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/401f21125b3146fe9deba3df1abf1803"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_401f21125b3146fe9deba3df1abf1803", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-VolumesActionsTest-1290209558 Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: 401f21125b3146fe9deba3df1abf1803 Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-VolumesActionsTest-1290209558 Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-VolumesActionsTest-1290209558-project Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: 4e8cc08181c74bb584fdca44adba662a Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-VolumesActionsTest-1290209558-project Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance 4e3a8b07-d821-446a-973d-0b71203ad7ed could not be found. Jul 18 08:54:48.078929 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': '4e3a8b07-d821-446a-973d-0b71203ad7ed'} Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3a8b07-d821-446a-973d-0b71203ad7ed could not be found. Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:54:48.080458 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3a8b07-d821-446a-973d-0b71203ad7ed could not be found. Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3a8b07-d821-446a-973d-0b71203ad7ed could not be found. Jul 18 08:54:48.082062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:54:48.083844 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a3610ec5-776e-4c18-98d4-a1133eb82a50 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] Returning 404 to user: Instance 4e3a8b07-d821-446a-973d-0b71203ad7ed could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:54:48.083844 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a3610ec5-776e-4c18-98d4-a1133eb82a50 tempest-VolumesActionsTest-1290209558 tempest-VolumesActionsTest-1290209558-project] 10.222.0.57 "GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed" status: 404 len: 111 microversion: 2.1 time: 0.051858 Jul 18 08:54:48.083844 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 482/967] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:54:48 2022] GET /compute/v2.1/servers/4e3a8b07-d821-446a-973d-0b71203ad7ed => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:55:16.990691 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1900998591", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "networks": [{"uuid": "00784d3b-b117-422c-8519-5074d6c7ced6"}]}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:17.005940 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:17.008449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:17.072460 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.network.neutron [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] validate_networks() for [('00784d3b-b117-422c-8519-5074d6c7ced6', None, None, None, None, None)] {{(pid=124894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:55:17.847007 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Flavor limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:55:17.848241 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Image limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:55:17.849417 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Flavor pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:55:17.851081 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Image pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:55:17.852255 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:55:17.872183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:17.873184 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:17.875567 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:17.876894 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:17.914223 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Getting quotas for project 3df75aa755784fee814abfd669ce02da. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:55:17.920391 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Getting quotas for user b9f08551f4ff4bbd9c48c438a518c8d0 and project 3df75aa755784fee814abfd669ce02da. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:55:17.938066 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Going to run 1 instances... {{(pid=124894) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:55:17.940550 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:55:18.254074 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-6ebbdbf8-7c16-4266-8874-ad9ca3542c94 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.269233 Jul 18 08:55:18.255425 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 486/968] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:55:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:55:18.269621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-481f1f1b-6a42-40ad-b32a-1fc662c39bc7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:18.270891 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-481f1f1b-6a42-40ad-b32a-1fc662c39bc7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:18.282537 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:18.284597 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:18.386069 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-481f1f1b-6a42-40ad-b32a-1fc662c39bc7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:18.407049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-481f1f1b-6a42-40ad-b32a-1fc662c39bc7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1219 microversion: 2.1 time: 0.143517 Jul 18 08:55:18.424822 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 483/969] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:18 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:19.433853 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-19946a03-39be-4569-87e9-e240d53f8d72 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:19.434544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-19946a03-39be-4569-87e9-e240d53f8d72 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:19.533437 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-19946a03-39be-4569-87e9-e240d53f8d72 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:19.541202 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-19946a03-39be-4569-87e9-e240d53f8d72 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1219 microversion: 2.1 time: 0.112440 Jul 18 08:55:19.541793 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 487/970] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:19 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:20.575113 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-cd97c724-d045-42dc-9173-1e9b5d9eb7a6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:20.578072 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-cd97c724-d045-42dc-9173-1e9b5d9eb7a6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:20.636546 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cd97c724-d045-42dc-9173-1e9b5d9eb7a6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:20.637939 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cd97c724-d045-42dc-9173-1e9b5d9eb7a6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:20.640311 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cd97c724-d045-42dc-9173-1e9b5d9eb7a6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:20.641419 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cd97c724-d045-42dc-9173-1e9b5d9eb7a6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:20.759821 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-cd97c724-d045-42dc-9173-1e9b5d9eb7a6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:20.775387 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-cd97c724-d045-42dc-9173-1e9b5d9eb7a6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1215 microversion: 2.1 time: 0.210915 Jul 18 08:55:20.776876 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 484/971] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:20 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1215 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:21.810110 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f03fb6b9-25de-4454-8577-45ee02bedc25 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:21.816922 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f03fb6b9-25de-4454-8577-45ee02bedc25 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:21.848478 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f03fb6b9-25de-4454-8577-45ee02bedc25 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:21.855240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f03fb6b9-25de-4454-8577-45ee02bedc25 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:21.855240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f03fb6b9-25de-4454-8577-45ee02bedc25 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:21.855240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f03fb6b9-25de-4454-8577-45ee02bedc25 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:22.036811 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f03fb6b9-25de-4454-8577-45ee02bedc25 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:22.064084 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f03fb6b9-25de-4454-8577-45ee02bedc25 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1279 microversion: 2.1 time: 0.257665 Jul 18 08:55:22.064084 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 488/972] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:21 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1279 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:23.088993 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d2a19447-a93c-4496-8d1c-9e5ab5f484e7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:23.088993 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d2a19447-a93c-4496-8d1c-9e5ab5f484e7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:23.100087 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2a19447-a93c-4496-8d1c-9e5ab5f484e7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:23.101212 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2a19447-a93c-4496-8d1c-9e5ab5f484e7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:23.102495 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2a19447-a93c-4496-8d1c-9e5ab5f484e7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:23.103696 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2a19447-a93c-4496-8d1c-9e5ab5f484e7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:23.315933 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d2a19447-a93c-4496-8d1c-9e5ab5f484e7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:23.328910 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d2a19447-a93c-4496-8d1c-9e5ab5f484e7 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1319 microversion: 2.1 time: 0.251959 Jul 18 08:55:23.331212 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 485/973] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:23 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:24.358760 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e3a55048-e4cc-47fd-a0d7-856cd4a86340 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:24.363054 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e3a55048-e4cc-47fd-a0d7-856cd4a86340 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:24.383035 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e3a55048-e4cc-47fd-a0d7-856cd4a86340 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:24.387396 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e3a55048-e4cc-47fd-a0d7-856cd4a86340 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:24.389804 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e3a55048-e4cc-47fd-a0d7-856cd4a86340 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:24.390851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e3a55048-e4cc-47fd-a0d7-856cd4a86340 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:24.638476 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e3a55048-e4cc-47fd-a0d7-856cd4a86340 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:24.664415 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e3a55048-e4cc-47fd-a0d7-856cd4a86340 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1319 microversion: 2.1 time: 0.312913 Jul 18 08:55:24.666479 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 489/974] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:24 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:24.784624 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-bdaafe7d-cb37-47a9-a704-1b0d861ca236 req-79410eb3-47b5-4001-8841-c5e53461eb6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b50d90-4a50-4c57-9a2f-67bc1f5ab177", "tag": "7161b4e3-57c9-4794-951c-1f8c38b0dad1"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:24.816853 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-bdaafe7d-cb37-47a9-a704-1b0d861ca236 req-79410eb3-47b5-4001-8841-c5e53461eb6d service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:24.825750 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-bdaafe7d-cb37-47a9-a704-1b0d861ca236 req-79410eb3-47b5-4001-8841-c5e53461eb6d service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:24.847422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-bdaafe7d-cb37-47a9-a704-1b0d861ca236 req-79410eb3-47b5-4001-8841-c5e53461eb6d service nova] Creating event network-changed:7161b4e3-57c9-4794-951c-1f8c38b0dad1 for instance 19b50d90-4a50-4c57-9a2f-67bc1f5ab177 on hv-cinder-85014 Jul 18 08:55:24.861181 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-bdaafe7d-cb37-47a9-a704-1b0d861ca236 req-79410eb3-47b5-4001-8841-c5e53461eb6d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084225 Jul 18 08:55:24.864007 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 486/975] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:55:25.108871 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1302190878", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-239426097", "security_groups": [{"name": "tempest-secgroup-smoke-1587307711"}], "block_device_mapping_v2": [{"uuid": "9b691bae-f904-45e7-be15-cf10e0571803", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "14ef1bb9-db47-48f8-bf4d-197c43ed89fa"}]}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:25.377724 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.network.neutron [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] validate_networks() for [('14ef1bb9-db47-48f8-bf4d-197c43ed89fa', None, None, None, None, None)] {{(pid=124894) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:55:25.697215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1f7b23ed-7137-4fcd-9b42-10fdb098dfcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:25.698709 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1f7b23ed-7137-4fcd-9b42-10fdb098dfcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:25.723930 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1f7b23ed-7137-4fcd-9b42-10fdb098dfcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:25.726251 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1f7b23ed-7137-4fcd-9b42-10fdb098dfcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:25.727228 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1f7b23ed-7137-4fcd-9b42-10fdb098dfcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:25.727766 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1f7b23ed-7137-4fcd-9b42-10fdb098dfcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:25.915595 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1f7b23ed-7137-4fcd-9b42-10fdb098dfcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:25.923815 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1f7b23ed-7137-4fcd-9b42-10fdb098dfcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1319 microversion: 2.1 time: 0.230856 Jul 18 08:55:25.924968 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 487/976] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:25 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:26.289496 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Flavor limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:55:26.289496 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Image limits 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:55:26.289496 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Flavor pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:55:26.289496 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Image pref 0:0:0 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:55:26.289496 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.virt.hardware [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124894) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:55:26.298431 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:26.299014 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:26.299963 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:26.300506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:26.321140 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Getting quotas for project d37f9217ffb94786830f0f6c5970b762. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:55:26.325951 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.quota [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Getting quotas for user ba4946e9565f4a608dd04fbc4de18dad and project d37f9217ffb94786830f0f6c5970b762. Resources: {'instances', 'ram', 'cores'} {{(pid=124894) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:55:26.398588 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Going to run 1 instances... {{(pid=124894) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:55:26.400794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b691bae-f904-45e7-be15-cf10e0571803',volume_size=None,volume_type=None)] {{(pid=124894) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:55:26.916165 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d37e3497-7322-4b29-96ea-67096f657072 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.811378 Jul 18 08:55:26.917630 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 490/977] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:55:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:55:26.928586 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b7d36e6a-6853-41b1-9282-0943b54691ec tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:26.929204 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b7d36e6a-6853-41b1-9282-0943b54691ec tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:26.944796 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-8b572c33-dd05-4ea9-92d2-1bb55d0420ae tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:26.945431 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-8b572c33-dd05-4ea9-92d2-1bb55d0420ae tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:26.962004 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b572c33-dd05-4ea9-92d2-1bb55d0420ae tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:26.962634 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b572c33-dd05-4ea9-92d2-1bb55d0420ae tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:26.963424 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b572c33-dd05-4ea9-92d2-1bb55d0420ae tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:26.963895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-8b572c33-dd05-4ea9-92d2-1bb55d0420ae tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:27.058427 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b7d36e6a-6853-41b1-9282-0943b54691ec tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:27.067777 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b7d36e6a-6853-41b1-9282-0943b54691ec tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1094 microversion: 2.1 time: 0.142873 Jul 18 08:55:27.070216 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 488/978] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:26 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1094 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:27.074947 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-380816864", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452"}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:27.150306 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] validate_networks() for None {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:55:27.410825 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-8b572c33-dd05-4ea9-92d2-1bb55d0420ae tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:27.419033 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-8b572c33-dd05-4ea9-92d2-1bb55d0420ae tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1319 microversion: 2.1 time: 0.478100 Jul 18 08:55:27.419627 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 491/979] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:26 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:27.815137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:55:27.815137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:55:27.815137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:55:27.815137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:55:27.815137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:55:27.822957 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:27.823412 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:27.824506 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:27.824945 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:27.852967 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Getting quotas for project 9945807f747246729410568cee6fc929. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:55:27.857540 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Getting quotas for user 343bb018170a49e09b72de95a19e769f and project 9945807f747246729410568cee6fc929. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:55:27.879127 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:55:27.881739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:55:28.064384 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-90c55e7e-c7d1-45c8-a216-42e5e83feea0 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994080 Jul 18 08:55:28.065322 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 489/980] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:55:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:55:28.081718 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-18a479d7-ac26-4af4-b106-9e0cc826c75f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:28.085812 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-18a479d7-ac26-4af4-b106-9e0cc826c75f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:28.086990 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4a620d70-9731-4aaa-b825-551fb69ea929 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:28.087892 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-4a620d70-9731-4aaa-b825-551fb69ea929 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:28.096438 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4a620d70-9731-4aaa-b825-551fb69ea929 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:28.097074 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4a620d70-9731-4aaa-b825-551fb69ea929 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:28.098110 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4a620d70-9731-4aaa-b825-551fb69ea929 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:28.098745 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4a620d70-9731-4aaa-b825-551fb69ea929 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:28.168565 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4a620d70-9731-4aaa-b825-551fb69ea929 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:28.177871 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-4a620d70-9731-4aaa-b825-551fb69ea929 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1144 microversion: 2.1 time: 0.095561 Jul 18 08:55:28.179367 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 490/981] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:28 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:28.188954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-18a479d7-ac26-4af4-b106-9e0cc826c75f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:28.197427 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-18a479d7-ac26-4af4-b106-9e0cc826c75f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1214 microversion: 2.1 time: 0.126032 Jul 18 08:55:28.211478 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 492/982] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:28 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:28.436627 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0e116561-df32-4bc1-9524-56b9895d058b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:28.437258 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0e116561-df32-4bc1-9524-56b9895d058b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:28.446912 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e116561-df32-4bc1-9524-56b9895d058b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:28.446912 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e116561-df32-4bc1-9524-56b9895d058b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:28.446912 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e116561-df32-4bc1-9524-56b9895d058b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:28.446912 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0e116561-df32-4bc1-9524-56b9895d058b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:28.674038 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0e116561-df32-4bc1-9524-56b9895d058b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:28.688374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0e116561-df32-4bc1-9524-56b9895d058b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1319 microversion: 2.1 time: 0.255804 Jul 18 08:55:28.695025 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 491/983] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:28 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:29.200029 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f7ef866c-e6ac-4bca-bdf5-7449c1ec6e82 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:29.202194 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f7ef866c-e6ac-4bca-bdf5-7449c1ec6e82 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:29.215558 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7ef866c-e6ac-4bca-bdf5-7449c1ec6e82 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:29.216399 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7ef866c-e6ac-4bca-bdf5-7449c1ec6e82 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:29.218734 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7ef866c-e6ac-4bca-bdf5-7449c1ec6e82 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:29.219864 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f7ef866c-e6ac-4bca-bdf5-7449c1ec6e82 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:29.222751 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-629e3b70-029d-4023-8648-c12d3bc13c33 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:29.224209 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-629e3b70-029d-4023-8648-c12d3bc13c33 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:29.297338 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-629e3b70-029d-4023-8648-c12d3bc13c33 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:29.301845 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f7ef866c-e6ac-4bca-bdf5-7449c1ec6e82 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:29.307506 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-629e3b70-029d-4023-8648-c12d3bc13c33 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1214 microversion: 2.1 time: 0.095284 Jul 18 08:55:29.308425 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 492/984] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:29 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:29.310421 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f7ef866c-e6ac-4bca-bdf5-7449c1ec6e82 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1192 microversion: 2.1 time: 0.117178 Jul 18 08:55:29.311260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 493/985] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:29 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1192 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:29.706390 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-026faa79-3571-4660-874b-ab9952c0c141 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:29.707053 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-026faa79-3571-4660-874b-ab9952c0c141 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:29.729413 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-026faa79-3571-4660-874b-ab9952c0c141 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:29.732218 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-026faa79-3571-4660-874b-ab9952c0c141 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:29.733253 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-026faa79-3571-4660-874b-ab9952c0c141 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:29.733891 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-026faa79-3571-4660-874b-ab9952c0c141 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:30.093737 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-026faa79-3571-4660-874b-ab9952c0c141 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:30.108469 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-026faa79-3571-4660-874b-ab9952c0c141 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1319 microversion: 2.1 time: 0.404893 Jul 18 08:55:30.110902 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 493/986] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:29 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:30.325084 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-af69577c-3d83-44ff-b16a-ab4346206d5d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:30.325815 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-af69577c-3d83-44ff-b16a-ab4346206d5d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:30.328462 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-55423d48-2fef-4a9e-a0c4-9fcf2a53a6f5 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:30.329147 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-55423d48-2fef-4a9e-a0c4-9fcf2a53a6f5 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:30.339169 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af69577c-3d83-44ff-b16a-ab4346206d5d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:30.340751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af69577c-3d83-44ff-b16a-ab4346206d5d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:30.349295 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55423d48-2fef-4a9e-a0c4-9fcf2a53a6f5 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:30.349295 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55423d48-2fef-4a9e-a0c4-9fcf2a53a6f5 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:30.349659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af69577c-3d83-44ff-b16a-ab4346206d5d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:30.349659 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-af69577c-3d83-44ff-b16a-ab4346206d5d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:30.349941 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55423d48-2fef-4a9e-a0c4-9fcf2a53a6f5 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:30.349941 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-55423d48-2fef-4a9e-a0c4-9fcf2a53a6f5 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:30.437571 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-af69577c-3d83-44ff-b16a-ab4346206d5d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:30.439932 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-55423d48-2fef-4a9e-a0c4-9fcf2a53a6f5 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:30.456339 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-af69577c-3d83-44ff-b16a-ab4346206d5d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1266 microversion: 2.1 time: 0.134142 Jul 18 08:55:30.464712 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-55423d48-2fef-4a9e-a0c4-9fcf2a53a6f5 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1210 microversion: 2.1 time: 0.132495 Jul 18 08:55:30.466230 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 494/988] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:30 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:30.466511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 494/988] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:30 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:31.128289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-909a561d-9809-4b02-8cc9-2654ed2ffa64 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:31.129034 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-909a561d-9809-4b02-8cc9-2654ed2ffa64 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:31.141661 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-909a561d-9809-4b02-8cc9-2654ed2ffa64 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:31.142117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-909a561d-9809-4b02-8cc9-2654ed2ffa64 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:31.142928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-909a561d-9809-4b02-8cc9-2654ed2ffa64 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:31.147725 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-909a561d-9809-4b02-8cc9-2654ed2ffa64 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:31.444686 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-909a561d-9809-4b02-8cc9-2654ed2ffa64 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:31.455786 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-909a561d-9809-4b02-8cc9-2654ed2ffa64 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1319 microversion: 2.1 time: 0.331089 Jul 18 08:55:31.457046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 495/989] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:31 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:31.474730 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f0b92ce0-a686-4ad2-9d93-26c714b089c1 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:31.480290 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f0b92ce0-a686-4ad2-9d93-26c714b089c1 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:31.509209 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1b282bcb-4307-4718-b3ba-2c903d1b242e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:31.509850 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1b282bcb-4307-4718-b3ba-2c903d1b242e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:31.517759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f0b92ce0-a686-4ad2-9d93-26c714b089c1 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:31.517759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f0b92ce0-a686-4ad2-9d93-26c714b089c1 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:31.525962 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f0b92ce0-a686-4ad2-9d93-26c714b089c1 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:31.526626 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f0b92ce0-a686-4ad2-9d93-26c714b089c1 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:31.536932 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1b282bcb-4307-4718-b3ba-2c903d1b242e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:31.537391 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1b282bcb-4307-4718-b3ba-2c903d1b242e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:31.538196 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1b282bcb-4307-4718-b3ba-2c903d1b242e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:31.538640 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1b282bcb-4307-4718-b3ba-2c903d1b242e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:31.675508 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f0b92ce0-a686-4ad2-9d93-26c714b089c1 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:31.687511 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f0b92ce0-a686-4ad2-9d93-26c714b089c1 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1272 microversion: 2.1 time: 0.217122 Jul 18 08:55:31.688700 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 495/990] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:31 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:31.804360 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-1b282bcb-4307-4718-b3ba-2c903d1b242e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:31.837059 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1b282bcb-4307-4718-b3ba-2c903d1b242e tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.341674 Jul 18 08:55:31.845202 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 496/991] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:31 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:32.273933 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-7b530713-bdb1-4d48-bd2a-f7cb382f32cc req-0a368cab-fa57-4418-8313-0838ef098b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b50d90-4a50-4c57-9a2f-67bc1f5ab177", "name": "network-vif-plugged", "status": "completed", "tag": "7161b4e3-57c9-4794-951c-1f8c38b0dad1"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:32.275344 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-d2c9df75-cdc6-489c-8198-8959818d7490 req-8f2a6f76-5671-41df-9af4-41df8e24c652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f97e59a-6d5c-465e-91a7-479df09355e9", "tag": "649f5ff3-9ef1-4a08-9cee-a5b3ce52f527"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:32.284152 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-7b530713-bdb1-4d48-bd2a-f7cb382f32cc req-0a368cab-fa57-4418-8313-0838ef098b9b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:32.296432 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-7b530713-bdb1-4d48-bd2a-f7cb382f32cc req-0a368cab-fa57-4418-8313-0838ef098b9b service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:32.304026 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-d2c9df75-cdc6-489c-8198-8959818d7490 req-8f2a6f76-5671-41df-9af4-41df8e24c652 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:32.304779 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-d2c9df75-cdc6-489c-8198-8959818d7490 req-8f2a6f76-5671-41df-9af4-41df8e24c652 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:32.323403 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-7b530713-bdb1-4d48-bd2a-f7cb382f32cc req-0a368cab-fa57-4418-8313-0838ef098b9b service nova] Creating event network-vif-plugged:7161b4e3-57c9-4794-951c-1f8c38b0dad1 for instance 19b50d90-4a50-4c57-9a2f-67bc1f5ab177 on hv-cinder-85014 Jul 18 08:55:32.336206 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-7b530713-bdb1-4d48-bd2a-f7cb382f32cc req-0a368cab-fa57-4418-8313-0838ef098b9b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065483 Jul 18 08:55:32.337578 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 496/992] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:55:32.339739 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-d2c9df75-cdc6-489c-8198-8959818d7490 req-8f2a6f76-5671-41df-9af4-41df8e24c652 service nova] Creating event network-changed:649f5ff3-9ef1-4a08-9cee-a5b3ce52f527 for instance 6f97e59a-6d5c-465e-91a7-479df09355e9 on hv-cinder-85014 Jul 18 08:55:32.367756 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-d2c9df75-cdc6-489c-8198-8959818d7490 req-8f2a6f76-5671-41df-9af4-41df8e24c652 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096483 Jul 18 08:55:32.368940 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 497/993] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:55:32.475276 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a84e159d-4ef0-4ac4-91b1-4a335cef904f tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:32.476325 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a84e159d-4ef0-4ac4-91b1-4a335cef904f tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:32.499252 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a84e159d-4ef0-4ac4-91b1-4a335cef904f tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:32.500012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a84e159d-4ef0-4ac4-91b1-4a335cef904f tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:32.500909 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a84e159d-4ef0-4ac4-91b1-4a335cef904f tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:32.501264 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a84e159d-4ef0-4ac4-91b1-4a335cef904f tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:32.720271 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-28597492-ccef-468c-96d4-7405ea1d2565 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:32.722817 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-28597492-ccef-468c-96d4-7405ea1d2565 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:32.734258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-28597492-ccef-468c-96d4-7405ea1d2565 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:32.734902 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-28597492-ccef-468c-96d4-7405ea1d2565 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:32.736612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-28597492-ccef-468c-96d4-7405ea1d2565 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:32.737386 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-28597492-ccef-468c-96d4-7405ea1d2565 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:32.925704 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-28597492-ccef-468c-96d4-7405ea1d2565 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:32.928075 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a84e159d-4ef0-4ac4-91b1-4a335cef904f tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:32.951654 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-28597492-ccef-468c-96d4-7405ea1d2565 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1272 microversion: 2.1 time: 0.234600 Jul 18 08:55:32.952794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 498/994] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:32 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:32.957355 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a84e159d-4ef0-4ac4-91b1-4a335cef904f tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1319 microversion: 2.1 time: 0.486270 Jul 18 08:55:32.959932 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 497/995] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:32 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:32.986475 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-490a9512-6008-450c-ab5a-1efdb235e69a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:32.986475 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-490a9512-6008-450c-ab5a-1efdb235e69a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:32.990562 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-490a9512-6008-450c-ab5a-1efdb235e69a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:32.990562 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-490a9512-6008-450c-ab5a-1efdb235e69a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:32.990562 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-490a9512-6008-450c-ab5a-1efdb235e69a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:32.990562 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-490a9512-6008-450c-ab5a-1efdb235e69a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:33.148475 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-490a9512-6008-450c-ab5a-1efdb235e69a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:33.159459 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-490a9512-6008-450c-ab5a-1efdb235e69a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.200391 Jul 18 08:55:33.160080 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 499/996] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:32 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:33.260586 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ac6f4b86-9224-4a39-bc84-f24f7e1b3a10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Action: 'create', calling method: .version_select at 0x7fafb7137dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1745644009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsiM18E3VHiJZCP8urGaJKQ8e2PrCaLwp0Oe42HaMfqTXwmuOPI1XjLJJYwuCpe6pwP68jABFjE0jhJnHTcHGuJbQFXSAirdw6W84wL4rjULnolfUeRruhp9oLD+SL7+A=="}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:33.282576 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-ac6f4b86-9224-4a39-bc84-f24f7e1b3a10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Getting quotas for project 98f69056ca3e4e7c83f6c36c8e16c16c. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:55:33.305221 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-ac6f4b86-9224-4a39-bc84-f24f7e1b3a10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Getting quotas for user 124957514a4e4c35bed50a19de1dda6d and project 98f69056ca3e4e7c83f6c36c8e16c16c. Resources: {'key_pairs'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:55:33.330145 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ac6f4b86-9224-4a39-bc84-f24f7e1b3a10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [e3cbcdec-6444-4210-bf3a-0e7d0c4d6997] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 08:55:33.973655 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c86ee5c1-009f-4077-8efd-99e68fd50a74 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:33.976167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c86ee5c1-009f-4077-8efd-99e68fd50a74 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:33.984081 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c86ee5c1-009f-4077-8efd-99e68fd50a74 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:33.985496 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c86ee5c1-009f-4077-8efd-99e68fd50a74 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:33.985496 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c86ee5c1-009f-4077-8efd-99e68fd50a74 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:33.985788 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c86ee5c1-009f-4077-8efd-99e68fd50a74 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:34.168484 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c86ee5c1-009f-4077-8efd-99e68fd50a74 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:34.180552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c86ee5c1-009f-4077-8efd-99e68fd50a74 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1314 microversion: 2.1 time: 0.211382 Jul 18 08:55:34.181449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 500/997] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:33 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:34.189401 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ef689b75-28fa-4301-9612-0e8e871c69f6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:34.190297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ef689b75-28fa-4301-9612-0e8e871c69f6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:34.207713 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ef689b75-28fa-4301-9612-0e8e871c69f6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:34.213703 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ef689b75-28fa-4301-9612-0e8e871c69f6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:34.214521 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ef689b75-28fa-4301-9612-0e8e871c69f6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:34.215225 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ef689b75-28fa-4301-9612-0e8e871c69f6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:34.341611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO oslo.messaging._drivers.impl_rabbit [None req-ac6f4b86-9224-4a39-bc84-f24f7e1b3a10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [e3cbcdec-6444-4210-bf3a-0e7d0c4d6997] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 43368. Jul 18 08:55:34.473491 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ac6f4b86-9224-4a39-bc84-f24f7e1b3a10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.431077 Jul 18 08:55:34.473491 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 498/998] 10.222.0.57 () {60 vars in 1158 bytes} [Mon Jul 18 08:55:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:55:34.480392 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0b585a7e-4b4a-4998-9959-c5e526fb3100 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:34.490987 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0b585a7e-4b4a-4998-9959-c5e526fb3100 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:34.511854 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ef689b75-28fa-4301-9612-0e8e871c69f6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:34.525463 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ef689b75-28fa-4301-9612-0e8e871c69f6 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1319 microversion: 2.1 time: 0.342610 Jul 18 08:55:34.526635 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b585a7e-4b4a-4998-9959-c5e526fb3100 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:34.527323 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b585a7e-4b4a-4998-9959-c5e526fb3100 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:34.532147 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b585a7e-4b4a-4998-9959-c5e526fb3100 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:34.532836 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b585a7e-4b4a-4998-9959-c5e526fb3100 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:34.533323 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 501/999] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:34 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:34.857289 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0b585a7e-4b4a-4998-9959-c5e526fb3100 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:34.867070 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0b585a7e-4b4a-4998-9959-c5e526fb3100 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.395848 Jul 18 08:55:34.870461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 499/1000] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:34 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:35.041543 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-c0dc7148-a1d3-4682-92f5-80f80bf1b10f req-45753ffe-7615-4ca6-b5fe-431c7dcef634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f791bf-03fa-4016-b8f1-d28726da0465", "tag": "c28baf2a-afc4-455e-a99f-1526738ed8c0"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:35.052451 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-c0dc7148-a1d3-4682-92f5-80f80bf1b10f req-45753ffe-7615-4ca6-b5fe-431c7dcef634 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:35.053041 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-c0dc7148-a1d3-4682-92f5-80f80bf1b10f req-45753ffe-7615-4ca6-b5fe-431c7dcef634 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:35.073602 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-c0dc7148-a1d3-4682-92f5-80f80bf1b10f req-45753ffe-7615-4ca6-b5fe-431c7dcef634 service nova] Creating event network-changed:c28baf2a-afc4-455e-a99f-1526738ed8c0 for instance 03f791bf-03fa-4016-b8f1-d28726da0465 on hv-cinder-85014 Jul 18 08:55:35.078161 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-c0dc7148-a1d3-4682-92f5-80f80bf1b10f req-45753ffe-7615-4ca6-b5fe-431c7dcef634 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040885 Jul 18 08:55:35.079088 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 502/1001] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:55:35.207838 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a0cd9533-2a97-4cb1-b574-53098dcd7581 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:35.215126 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a0cd9533-2a97-4cb1-b574-53098dcd7581 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:35.219715 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a0cd9533-2a97-4cb1-b574-53098dcd7581 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:35.220322 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a0cd9533-2a97-4cb1-b574-53098dcd7581 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:35.221218 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a0cd9533-2a97-4cb1-b574-53098dcd7581 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:35.221663 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a0cd9533-2a97-4cb1-b574-53098dcd7581 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:35.527304 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a0cd9533-2a97-4cb1-b574-53098dcd7581 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:35.539273 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a0cd9533-2a97-4cb1-b574-53098dcd7581 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1314 microversion: 2.1 time: 0.336106 Jul 18 08:55:35.541337 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 500/1002] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:35 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:35.568952 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a3e4ce1d-3d8b-4d2b-8548-ccc7ed8216bc tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:35.570826 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a3e4ce1d-3d8b-4d2b-8548-ccc7ed8216bc tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:35.582646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3e4ce1d-3d8b-4d2b-8548-ccc7ed8216bc tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:35.584237 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3e4ce1d-3d8b-4d2b-8548-ccc7ed8216bc tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:35.586375 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3e4ce1d-3d8b-4d2b-8548-ccc7ed8216bc tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:35.588191 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a3e4ce1d-3d8b-4d2b-8548-ccc7ed8216bc tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:35.805702 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a3e4ce1d-3d8b-4d2b-8548-ccc7ed8216bc tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:35.815952 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a3e4ce1d-3d8b-4d2b-8548-ccc7ed8216bc tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1508 microversion: 2.1 time: 0.255029 Jul 18 08:55:35.827144 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 503/1003] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:35 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:35.890137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-601d9fb8-19ed-400c-95f8-eadbe8c25018 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:35.890137 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-601d9fb8-19ed-400c-95f8-eadbe8c25018 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:35.913171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-601d9fb8-19ed-400c-95f8-eadbe8c25018 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:35.913171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-601d9fb8-19ed-400c-95f8-eadbe8c25018 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:35.913664 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-601d9fb8-19ed-400c-95f8-eadbe8c25018 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:35.914111 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-601d9fb8-19ed-400c-95f8-eadbe8c25018 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:36.233641 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-601d9fb8-19ed-400c-95f8-eadbe8c25018 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:36.247562 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-601d9fb8-19ed-400c-95f8-eadbe8c25018 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.367445 Jul 18 08:55:36.252373 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 501/1004] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:35 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:36.568105 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f01bdeac-b83e-4229-80be-4d719ccad29d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:36.568768 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f01bdeac-b83e-4229-80be-4d719ccad29d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:36.578939 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=4 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:36.599910 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f01bdeac-b83e-4229-80be-4d719ccad29d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:36.599910 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f01bdeac-b83e-4229-80be-4d719ccad29d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:36.599910 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f01bdeac-b83e-4229-80be-4d719ccad29d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:36.599910 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f01bdeac-b83e-4229-80be-4d719ccad29d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:36.801476 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f01bdeac-b83e-4229-80be-4d719ccad29d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:36.832049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f01bdeac-b83e-4229-80be-4d719ccad29d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1314 microversion: 2.1 time: 0.268056 Jul 18 08:55:36.866073 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 504/1005] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:36 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:37.271769 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9d60c25d-146e-4484-b7bf-52378c3ccb1a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:37.272882 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9d60c25d-146e-4484-b7bf-52378c3ccb1a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:37.281009 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9d60c25d-146e-4484-b7bf-52378c3ccb1a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:37.281553 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9d60c25d-146e-4484-b7bf-52378c3ccb1a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:37.282685 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9d60c25d-146e-4484-b7bf-52378c3ccb1a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:37.283341 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9d60c25d-146e-4484-b7bf-52378c3ccb1a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:37.558594 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9d60c25d-146e-4484-b7bf-52378c3ccb1a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:37.567080 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9d60c25d-146e-4484-b7bf-52378c3ccb1a tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.303363 Jul 18 08:55:37.567684 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 502/1006] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:37 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:37.860627 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-244cf1e2-d104-4a4d-b309-d85c5b6205a2 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:37.861822 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-244cf1e2-d104-4a4d-b309-d85c5b6205a2 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:37.874057 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-244cf1e2-d104-4a4d-b309-d85c5b6205a2 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:37.874876 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-244cf1e2-d104-4a4d-b309-d85c5b6205a2 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:37.876337 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-244cf1e2-d104-4a4d-b309-d85c5b6205a2 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:37.877271 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-244cf1e2-d104-4a4d-b309-d85c5b6205a2 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:38.098872 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-244cf1e2-d104-4a4d-b309-d85c5b6205a2 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:38.109136 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-244cf1e2-d104-4a4d-b309-d85c5b6205a2 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1314 microversion: 2.1 time: 0.255077 Jul 18 08:55:38.109759 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 505/1007] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:37 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:38.584949 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f59010bb-f8c0-464f-b484-dd60fe4d115c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:38.585688 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f59010bb-f8c0-464f-b484-dd60fe4d115c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:38.588076 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:38.596311 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f59010bb-f8c0-464f-b484-dd60fe4d115c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:38.596964 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f59010bb-f8c0-464f-b484-dd60fe4d115c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:38.598287 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f59010bb-f8c0-464f-b484-dd60fe4d115c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:38.599192 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f59010bb-f8c0-464f-b484-dd60fe4d115c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:38.774022 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f59010bb-f8c0-464f-b484-dd60fe4d115c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:38.788565 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f59010bb-f8c0-464f-b484-dd60fe4d115c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.207607 Jul 18 08:55:38.789619 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 503/1008] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:38 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:39.130347 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-516add30-6708-43c6-956d-25002bdf4a26 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:39.131023 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-516add30-6708-43c6-956d-25002bdf4a26 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:39.133132 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=16 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:39.140049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-516add30-6708-43c6-956d-25002bdf4a26 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:39.140049 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-516add30-6708-43c6-956d-25002bdf4a26 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:39.140517 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-516add30-6708-43c6-956d-25002bdf4a26 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:39.140962 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-516add30-6708-43c6-956d-25002bdf4a26 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:39.588112 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-516add30-6708-43c6-956d-25002bdf4a26 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:39.597277 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-516add30-6708-43c6-956d-25002bdf4a26 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1314 microversion: 2.1 time: 0.471581 Jul 18 08:55:39.597872 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 506/1009] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:39 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:39.814925 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a729b93a-4df1-4c65-8d83-f0b6e2c8a355 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:39.815550 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a729b93a-4df1-4c65-8d83-f0b6e2c8a355 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:39.822339 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a729b93a-4df1-4c65-8d83-f0b6e2c8a355 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:39.823140 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a729b93a-4df1-4c65-8d83-f0b6e2c8a355 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:39.823587 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a729b93a-4df1-4c65-8d83-f0b6e2c8a355 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:39.824306 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a729b93a-4df1-4c65-8d83-f0b6e2c8a355 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:39.977370 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a729b93a-4df1-4c65-8d83-f0b6e2c8a355 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:39.985481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a729b93a-4df1-4c65-8d83-f0b6e2c8a355 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.174756 Jul 18 08:55:39.986156 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 504/1010] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:39 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:40.621080 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e9c633a2-fd3e-4b99-9fd0-528aea19041d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:40.622935 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e9c633a2-fd3e-4b99-9fd0-528aea19041d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:40.631815 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e9c633a2-fd3e-4b99-9fd0-528aea19041d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:40.632289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e9c633a2-fd3e-4b99-9fd0-528aea19041d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:40.633474 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e9c633a2-fd3e-4b99-9fd0-528aea19041d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:40.633919 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e9c633a2-fd3e-4b99-9fd0-528aea19041d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:40.638397 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=100 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:40.779959 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e9c633a2-fd3e-4b99-9fd0-528aea19041d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:40.788707 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e9c633a2-fd3e-4b99-9fd0-528aea19041d tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1314 microversion: 2.1 time: 0.176096 Jul 18 08:55:40.789358 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 507/1011] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:40 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:41.002890 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-78513529-28e7-4c96-b41d-d3d5c08328e6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:41.003447 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-78513529-28e7-4c96-b41d-d3d5c08328e6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:41.009594 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-78513529-28e7-4c96-b41d-d3d5c08328e6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:41.010046 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-78513529-28e7-4c96-b41d-d3d5c08328e6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:41.010824 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-78513529-28e7-4c96-b41d-d3d5c08328e6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:41.011261 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-78513529-28e7-4c96-b41d-d3d5c08328e6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:41.032523 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=100 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:41.166568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-78513529-28e7-4c96-b41d-d3d5c08328e6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:41.168425 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-78513529-28e7-4c96-b41d-d3d5c08328e6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.168055 Jul 18 08:55:41.168425 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 505/1012] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:40 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:41.812737 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bcba7fa8-f87e-4c44-afef-b921d6ab8e1e tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:41.814920 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bcba7fa8-f87e-4c44-afef-b921d6ab8e1e tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:41.822281 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bcba7fa8-f87e-4c44-afef-b921d6ab8e1e tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:41.822740 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bcba7fa8-f87e-4c44-afef-b921d6ab8e1e tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:41.823572 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bcba7fa8-f87e-4c44-afef-b921d6ab8e1e tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:41.824318 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bcba7fa8-f87e-4c44-afef-b921d6ab8e1e tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:41.985454 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bcba7fa8-f87e-4c44-afef-b921d6ab8e1e tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:41.993813 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bcba7fa8-f87e-4c44-afef-b921d6ab8e1e tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1314 microversion: 2.1 time: 0.190071 Jul 18 08:55:41.994396 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 508/1013] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:41 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:42.156956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-d5a459c4-e1a6-4b99-81e7-55bca035bcf0 req-5e16e2dc-4c21-4da7-b50d-dbb7b241081c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f791bf-03fa-4016-b8f1-d28726da0465", "name": "network-vif-plugged", "status": "completed", "tag": "c28baf2a-afc4-455e-a99f-1526738ed8c0"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:42.167449 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-d5a459c4-e1a6-4b99-81e7-55bca035bcf0 req-5e16e2dc-4c21-4da7-b50d-dbb7b241081c service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:42.168180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-d5a459c4-e1a6-4b99-81e7-55bca035bcf0 req-5e16e2dc-4c21-4da7-b50d-dbb7b241081c service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:42.183850 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-d5a459c4-e1a6-4b99-81e7-55bca035bcf0 req-5e16e2dc-4c21-4da7-b50d-dbb7b241081c service nova] Creating event network-vif-plugged:c28baf2a-afc4-455e-a99f-1526738ed8c0 for instance 03f791bf-03fa-4016-b8f1-d28726da0465 on hv-cinder-85014 Jul 18 08:55:42.190151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d27681c5-ddc7-49d7-8058-5c1d0e577097 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:42.190317 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-d5a459c4-e1a6-4b99-81e7-55bca035bcf0 req-5e16e2dc-4c21-4da7-b50d-dbb7b241081c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036693 Jul 18 08:55:42.190448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d27681c5-ddc7-49d7-8058-5c1d0e577097 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:42.191615 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 506/1014] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:55:42.197847 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d27681c5-ddc7-49d7-8058-5c1d0e577097 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:42.198305 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d27681c5-ddc7-49d7-8058-5c1d0e577097 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:42.199346 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d27681c5-ddc7-49d7-8058-5c1d0e577097 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:42.199882 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d27681c5-ddc7-49d7-8058-5c1d0e577097 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:42.367213 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d27681c5-ddc7-49d7-8058-5c1d0e577097 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:42.376189 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d27681c5-ddc7-49d7-8058-5c1d0e577097 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.196604 Jul 18 08:55:42.376722 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 509/1015] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:42 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:43.015138 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-942bde64-1b2a-4467-986a-7bd4e66685d7 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:43.015775 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-942bde64-1b2a-4467-986a-7bd4e66685d7 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:43.021972 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-942bde64-1b2a-4467-986a-7bd4e66685d7 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:43.022416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-942bde64-1b2a-4467-986a-7bd4e66685d7 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:43.023180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-942bde64-1b2a-4467-986a-7bd4e66685d7 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:43.023611 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-942bde64-1b2a-4467-986a-7bd4e66685d7 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:43.166182 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-942bde64-1b2a-4467-986a-7bd4e66685d7 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:43.175183 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-942bde64-1b2a-4467-986a-7bd4e66685d7 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1314 microversion: 2.1 time: 0.164064 Jul 18 08:55:43.175425 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 507/1016] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:43 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:43.393437 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-d9ecd9b2-7b6f-484b-b780-5f2860f8cc1d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:43.394028 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-d9ecd9b2-7b6f-484b-b780-5f2860f8cc1d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:43.400624 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d9ecd9b2-7b6f-484b-b780-5f2860f8cc1d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:43.401067 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d9ecd9b2-7b6f-484b-b780-5f2860f8cc1d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:43.401833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d9ecd9b2-7b6f-484b-b780-5f2860f8cc1d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:43.402268 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-d9ecd9b2-7b6f-484b-b780-5f2860f8cc1d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:43.541871 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-d9ecd9b2-7b6f-484b-b780-5f2860f8cc1d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:43.550463 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-d9ecd9b2-7b6f-484b-b780-5f2860f8cc1d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.161196 Jul 18 08:55:43.551053 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 510/1017] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:43 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:44.192478 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1d8af534-d5d8-4f14-8e64-a31b5a3f0192 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:44.193104 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1d8af534-d5d8-4f14-8e64-a31b5a3f0192 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:44.196306 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=16 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:44.201803 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1d8af534-d5d8-4f14-8e64-a31b5a3f0192 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:44.202606 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1d8af534-d5d8-4f14-8e64-a31b5a3f0192 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:44.203365 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1d8af534-d5d8-4f14-8e64-a31b5a3f0192 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:44.203839 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1d8af534-d5d8-4f14-8e64-a31b5a3f0192 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:44.353873 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1d8af534-d5d8-4f14-8e64-a31b5a3f0192 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:44.362106 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1d8af534-d5d8-4f14-8e64-a31b5a3f0192 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1314 microversion: 2.1 time: 0.174489 Jul 18 08:55:44.362688 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 508/1018] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:44 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:44.568101 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c726fb57-eadb-45e4-955b-b9769913589d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:44.569166 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c726fb57-eadb-45e4-955b-b9769913589d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:44.577511 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c726fb57-eadb-45e4-955b-b9769913589d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:44.577973 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c726fb57-eadb-45e4-955b-b9769913589d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:44.578762 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c726fb57-eadb-45e4-955b-b9769913589d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:44.579209 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c726fb57-eadb-45e4-955b-b9769913589d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:44.722091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c726fb57-eadb-45e4-955b-b9769913589d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:44.730182 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c726fb57-eadb-45e4-955b-b9769913589d tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.166300 Jul 18 08:55:44.730791 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 511/1019] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:44 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:45.380107 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9328724f-9fe8-4fb2-9bad-3b0a3f14a6f5 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:45.380889 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9328724f-9fe8-4fb2-9bad-3b0a3f14a6f5 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:45.387562 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9328724f-9fe8-4fb2-9bad-3b0a3f14a6f5 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:45.388043 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9328724f-9fe8-4fb2-9bad-3b0a3f14a6f5 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:45.389445 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9328724f-9fe8-4fb2-9bad-3b0a3f14a6f5 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:45.389888 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9328724f-9fe8-4fb2-9bad-3b0a3f14a6f5 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:45.534797 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9328724f-9fe8-4fb2-9bad-3b0a3f14a6f5 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:45.543487 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9328724f-9fe8-4fb2-9bad-3b0a3f14a6f5 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1462 microversion: 2.1 time: 0.167255 Jul 18 08:55:45.544196 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 509/1020] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:45 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1462 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:45.585794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-517a3bb5-53d9-4af6-b33d-5cbeed05861f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:45.586358 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-517a3bb5-53d9-4af6-b33d-5cbeed05861f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:45.593546 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-517a3bb5-53d9-4af6-b33d-5cbeed05861f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:45.593998 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-517a3bb5-53d9-4af6-b33d-5cbeed05861f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:45.594768 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-517a3bb5-53d9-4af6-b33d-5cbeed05861f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:45.595319 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-517a3bb5-53d9-4af6-b33d-5cbeed05861f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:45.627905 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-517a3bb5-53d9-4af6-b33d-5cbeed05861f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:55:45.749800 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-95873d51-7b7e-4a71-83c1-854f5df75200 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:45.750411 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-95873d51-7b7e-4a71-83c1-854f5df75200 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:45.756572 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-95873d51-7b7e-4a71-83c1-854f5df75200 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:45.757230 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-95873d51-7b7e-4a71-83c1-854f5df75200 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:45.757779 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-95873d51-7b7e-4a71-83c1-854f5df75200 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:45.758214 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-95873d51-7b7e-4a71-83c1-854f5df75200 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:45.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-517a3bb5-53d9-4af6-b33d-5cbeed05861f tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "DELETE /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 204 len: 0 microversion: 2.1 time: 0.312657 Jul 18 08:55:45.902217 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 512/1021] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:55:45 2022] DELETE /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:55:45.904454 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c02de765-2d17-4609-9d3c-029e4d7a57ea tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:45.905435 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c02de765-2d17-4609-9d3c-029e4d7a57ea tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:45.912315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c02de765-2d17-4609-9d3c-029e4d7a57ea tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:45.912868 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c02de765-2d17-4609-9d3c-029e4d7a57ea tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:45.913864 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c02de765-2d17-4609-9d3c-029e4d7a57ea tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:45.914144 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c02de765-2d17-4609-9d3c-029e4d7a57ea tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:45.916883 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-95873d51-7b7e-4a71-83c1-854f5df75200 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:45.927705 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-95873d51-7b7e-4a71-83c1-854f5df75200 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.183109 Jul 18 08:55:45.928329 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 510/1022] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:45 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:46.061707 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-c02de765-2d17-4609-9d3c-029e4d7a57ea tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:46.070739 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c02de765-2d17-4609-9d3c-029e4d7a57ea tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1468 microversion: 2.1 time: 0.170542 Jul 18 08:55:46.071513 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 513/1023] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:45 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1468 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:46.166671 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-fa6724f2-8fe3-4590-bbf7-855fc5f91039 req-de75e660-6a5f-44b4-be88-7602bd2874b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f97e59a-6d5c-465e-91a7-479df09355e9", "name": "network-vif-plugged", "status": "completed", "tag": "649f5ff3-9ef1-4a08-9cee-a5b3ce52f527"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:46.175794 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-fa6724f2-8fe3-4590-bbf7-855fc5f91039 req-de75e660-6a5f-44b4-be88-7602bd2874b5 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:46.176242 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-fa6724f2-8fe3-4590-bbf7-855fc5f91039 req-de75e660-6a5f-44b4-be88-7602bd2874b5 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:46.188006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-fa6724f2-8fe3-4590-bbf7-855fc5f91039 req-de75e660-6a5f-44b4-be88-7602bd2874b5 service nova] Creating event network-vif-plugged:649f5ff3-9ef1-4a08-9cee-a5b3ce52f527 for instance 6f97e59a-6d5c-465e-91a7-479df09355e9 on hv-cinder-85014 Jul 18 08:55:46.193048 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-fa6724f2-8fe3-4590-bbf7-855fc5f91039 req-de75e660-6a5f-44b4-be88-7602bd2874b5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030104 Jul 18 08:55:46.193648 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 511/1024] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:55:46.944353 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-dfb7bf24-2ce7-4e8c-a200-5beafa10d52c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:46.944833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-dfb7bf24-2ce7-4e8c-a200-5beafa10d52c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:46.952999 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dfb7bf24-2ce7-4e8c-a200-5beafa10d52c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:46.953450 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dfb7bf24-2ce7-4e8c-a200-5beafa10d52c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:46.954275 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dfb7bf24-2ce7-4e8c-a200-5beafa10d52c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:46.954714 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-dfb7bf24-2ce7-4e8c-a200-5beafa10d52c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:47.095555 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3daec082-44de-482c-9693-9206028eb4ac tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:47.096300 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3daec082-44de-482c-9693-9206028eb4ac tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:47.102787 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3daec082-44de-482c-9693-9206028eb4ac tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:47.103238 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3daec082-44de-482c-9693-9206028eb4ac tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:47.104058 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3daec082-44de-482c-9693-9206028eb4ac tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:47.104501 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3daec082-44de-482c-9693-9206028eb4ac tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:47.105610 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-dfb7bf24-2ce7-4e8c-a200-5beafa10d52c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:47.114144 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-dfb7bf24-2ce7-4e8c-a200-5beafa10d52c tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.173661 Jul 18 08:55:47.114727 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 514/1025] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:46 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:47.252908 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3daec082-44de-482c-9693-9206028eb4ac tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:47.262147 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3daec082-44de-482c-9693-9206028eb4ac tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1468 microversion: 2.1 time: 0.171883 Jul 18 08:55:47.262773 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 512/1026] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:47 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1468 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:48.077151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-8edc9993-a2c2-4ea2-9ab1-f77ca9b0a917 req-b01f6d84-8b9d-4ea3-93a4-cc64977c4687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f791bf-03fa-4016-b8f1-d28726da0465", "name": "network-vif-deleted", "tag": "c28baf2a-afc4-455e-a99f-1526738ed8c0"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:48.081751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:55:48.087627 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-8edc9993-a2c2-4ea2-9ab1-f77ca9b0a917 req-b01f6d84-8b9d-4ea3-93a4-cc64977c4687 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:48.088168 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-8edc9993-a2c2-4ea2-9ab1-f77ca9b0a917 req-b01f6d84-8b9d-4ea3-93a4-cc64977c4687 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:48.101917 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-8edc9993-a2c2-4ea2-9ab1-f77ca9b0a917 req-b01f6d84-8b9d-4ea3-93a4-cc64977c4687 service nova] Creating event network-vif-deleted:c28baf2a-afc4-455e-a99f-1526738ed8c0 for instance 03f791bf-03fa-4016-b8f1-d28726da0465 on hv-cinder-85014 Jul 18 08:55:48.109179 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-8edc9993-a2c2-4ea2-9ab1-f77ca9b0a917 req-b01f6d84-8b9d-4ea3-93a4-cc64977c4687 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036159 Jul 18 08:55:48.110107 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 515/1027] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:55:48.132787 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-bff0f88a-4fa8-442f-935c-6ec07ffd43a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:48.133376 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-bff0f88a-4fa8-442f-935c-6ec07ffd43a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:48.140739 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bff0f88a-4fa8-442f-935c-6ec07ffd43a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:48.141203 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bff0f88a-4fa8-442f-935c-6ec07ffd43a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:48.141999 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bff0f88a-4fa8-442f-935c-6ec07ffd43a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:48.142644 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bff0f88a-4fa8-442f-935c-6ec07ffd43a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:48.281579 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-414162d2-d529-454c-bdb6-7951fbe40546 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:48.282210 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-414162d2-d529-454c-bdb6-7951fbe40546 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:48.289288 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-414162d2-d529-454c-bdb6-7951fbe40546 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:48.289758 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-414162d2-d529-454c-bdb6-7951fbe40546 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:48.290544 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-414162d2-d529-454c-bdb6-7951fbe40546 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:48.291057 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-414162d2-d529-454c-bdb6-7951fbe40546 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:48.303604 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-bff0f88a-4fa8-442f-935c-6ec07ffd43a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:48.310981 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-bff0f88a-4fa8-442f-935c-6ec07ffd43a3 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1266 microversion: 2.1 time: 0.182327 Jul 18 08:55:48.311571 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 513/1028] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:48 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:48.374746 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-414162d2-d529-454c-bdb6-7951fbe40546 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:48.382831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-414162d2-d529-454c-bdb6-7951fbe40546 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1426 microversion: 2.1 time: 0.106492 Jul 18 08:55:48.383410 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 516/1029] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:48 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1426 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:49.328648 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-31c43f8d-9277-413c-966b-d49bbad21ec0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:49.329536 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-31c43f8d-9277-413c-966b-d49bbad21ec0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:49.339401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-31c43f8d-9277-413c-966b-d49bbad21ec0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:49.340261 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-31c43f8d-9277-413c-966b-d49bbad21ec0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:49.342097 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-31c43f8d-9277-413c-966b-d49bbad21ec0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:49.342581 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-31c43f8d-9277-413c-966b-d49bbad21ec0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:49.403405 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a919979d-0317-4684-a40d-e01ec11779fb tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:49.405297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a919979d-0317-4684-a40d-e01ec11779fb tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:49.415312 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a919979d-0317-4684-a40d-e01ec11779fb tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:49.416108 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a919979d-0317-4684-a40d-e01ec11779fb tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:49.417155 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a919979d-0317-4684-a40d-e01ec11779fb tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:49.417607 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a919979d-0317-4684-a40d-e01ec11779fb tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:49.459338 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a919979d-0317-4684-a40d-e01ec11779fb tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:49.459826 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a919979d-0317-4684-a40d-e01ec11779fb tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:49.460293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-a919979d-0317-4684-a40d-e01ec11779fb tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lazy-loading 'fault' on Instance uuid 03f791bf-03fa-4016-b8f1-d28726da0465 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:55:49.511157 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-31c43f8d-9277-413c-966b-d49bbad21ec0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:49.520986 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-31c43f8d-9277-413c-966b-d49bbad21ec0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1452 microversion: 2.1 time: 0.196158 Jul 18 08:55:49.522193 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 514/1030] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:49 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1452 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:49.522800 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a919979d-0317-4684-a40d-e01ec11779fb tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '343bb018170a49e09b72de95a19e769f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9945807f747246729410568cee6fc929', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:49.533296 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a919979d-0317-4684-a40d-e01ec11779fb tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 200 len: 1304 microversion: 2.1 time: 0.134566 Jul 18 08:55:49.534135 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 517/1031] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:49 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:55:49.544165 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3855745a-fd99-444b-a258-d29b7813b5f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:49.545711 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3855745a-fd99-444b-a258-d29b7813b5f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:49.553419 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3855745a-fd99-444b-a258-d29b7813b5f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:49.553419 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3855745a-fd99-444b-a258-d29b7813b5f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:49.553897 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3855745a-fd99-444b-a258-d29b7813b5f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:49.554271 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3855745a-fd99-444b-a258-d29b7813b5f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:49.705609 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3855745a-fd99-444b-a258-d29b7813b5f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:55:49.714409 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3855745a-fd99-444b-a258-d29b7813b5f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1452 microversion: 2.1 time: 0.177407 Jul 18 08:55:49.717515 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 515/1032] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:49 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:55:50.551256 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3c5e1c28-6d68-4f51-8220-4a6941ef1776 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:55:50.552505 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-3c5e1c28-6d68-4f51-8220-4a6941ef1776 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] [instance: 03f791bf-03fa-4016-b8f1-d28726da0465] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:50.559476 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3c5e1c28-6d68-4f51-8220-4a6941ef1776 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:50.560404 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3c5e1c28-6d68-4f51-8220-4a6941ef1776 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:50.561812 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3c5e1c28-6d68-4f51-8220-4a6941ef1776 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:50.562261 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3c5e1c28-6d68-4f51-8220-4a6941ef1776 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:50.579356 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-3c5e1c28-6d68-4f51-8220-4a6941ef1776 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] HTTP exception thrown: Instance 03f791bf-03fa-4016-b8f1-d28726da0465 could not be found. Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3c5e1c28-6d68-4f51-8220-4a6941ef1776 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Request method failure captured: Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 HTTP/1.1 Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R_8qSEwU_5br0eeCr-Krw1qtyAPCtLj_MxBohRJ_3dCpK_VoVjaluDe9If2x00-UrRYMtj-tHfVijKgIGkLXpAxgQpregewq04Bqyz5YUekal0ws6QNx3rUsfRFqHD2buYhA_FDp0HtYA8Xmqr_37tWhsBe-bt6f6TwKrHGCbfAYhw Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: 9945807f747246729410568cee6fc929 Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-VolumesNegativeTest-2127293993 Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:55:50.581078 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9945807f747246729410568cee6fc929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9945807f747246729410568cee6fc929"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9945807f747246729410568cee6fc929"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9945807f747246729410568cee6fc929", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-VolumesNegativeTest-2127293993 Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: 9945807f747246729410568cee6fc929 Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-VolumesNegativeTest-2127293993 Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-VolumesNegativeTest-2127293993-project Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 343bb018170a49e09b72de95a19e769f Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-VolumesNegativeTest-2127293993-project Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 03f791bf-03fa-4016-b8f1-d28726da0465 could not be found. Jul 18 08:55:50.582986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '03f791bf-03fa-4016-b8f1-d28726da0465'} Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f791bf-03fa-4016-b8f1-d28726da0465 could not be found. Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:55:50.584831 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f791bf-03fa-4016-b8f1-d28726da0465 could not be found. Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f791bf-03fa-4016-b8f1-d28726da0465 could not be found. Jul 18 08:55:50.587114 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:55:50.589503 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3c5e1c28-6d68-4f51-8220-4a6941ef1776 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] Returning 404 to user: Instance 03f791bf-03fa-4016-b8f1-d28726da0465 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:55:50.589503 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-3c5e1c28-6d68-4f51-8220-4a6941ef1776 tempest-VolumesNegativeTest-2127293993 tempest-VolumesNegativeTest-2127293993-project] 10.222.0.57 "GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465" status: 404 len: 111 microversion: 2.1 time: 0.035455 Jul 18 08:55:50.589503 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 518/1033] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:55:50 2022] GET /compute/v2.1/servers/03f791bf-03fa-4016-b8f1-d28726da0465 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:55:52.030088 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-21078db7-04b0-4eaf-8af6-303e251054c4 req-df0d5b71-0b5c-418b-a78f-79cdf84d015f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f97e59a-6d5c-465e-91a7-479df09355e9", "tag": "649f5ff3-9ef1-4a08-9cee-a5b3ce52f527"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:52.051898 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-21078db7-04b0-4eaf-8af6-303e251054c4 req-df0d5b71-0b5c-418b-a78f-79cdf84d015f service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:52.053043 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-21078db7-04b0-4eaf-8af6-303e251054c4 req-df0d5b71-0b5c-418b-a78f-79cdf84d015f service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:52.078791 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-21078db7-04b0-4eaf-8af6-303e251054c4 req-df0d5b71-0b5c-418b-a78f-79cdf84d015f service nova] Creating event network-changed:649f5ff3-9ef1-4a08-9cee-a5b3ce52f527 for instance 6f97e59a-6d5c-465e-91a7-479df09355e9 on hv-cinder-85014 Jul 18 08:55:52.086941 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-21078db7-04b0-4eaf-8af6-303e251054c4 req-df0d5b71-0b5c-418b-a78f-79cdf84d015f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066264 Jul 18 08:55:52.087543 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 516/1034] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:55:59.184813 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-71c283f5-12e0-4d4b-b253-a1fbeeddfbcf tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f79fa664-ed83-4e71-a830-10703b10ab4d", "device": "/dev/sdb"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:55:59.186404 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-71c283f5-12e0-4d4b-b253-a1fbeeddfbcf tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:55:59.193424 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71c283f5-12e0-4d4b-b253-a1fbeeddfbcf tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:59.193873 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71c283f5-12e0-4d4b-b253-a1fbeeddfbcf tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:55:59.194650 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71c283f5-12e0-4d4b-b253-a1fbeeddfbcf tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:55:59.195083 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-71c283f5-12e0-4d4b-b253-a1fbeeddfbcf tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:00.081939 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-71c283f5-12e0-4d4b-b253-a1fbeeddfbcf tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "POST /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901068 Jul 18 08:56:00.082565 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 519/1035] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:55:59 2022] POST /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:56:01.769585 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-108798622", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1745644009", "security_groups": [{"name": "tempest-secgroup-smoke-1699322790"}], "networks": [{"uuid": "77fb5333-2466-4ce0-ab30-1a0009326272"}], "block_device_mapping_v2": [{"uuid": "293d888c-2ec0-419a-a109-f8b04f7512b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:56:01.777631 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:02.063181 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=56 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:02.161639 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] validate_networks() for [('77fb5333-2466-4ce0-ab30-1a0009326272', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:56:02.555260 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:56:02.555717 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:56:02.556194 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:56:02.556655 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:56:02.557068 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:56:02.567074 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:02.567523 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:02.568371 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:02.568803 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:02.586221 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Getting quotas for project 98f69056ca3e4e7c83f6c36c8e16c16c. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:56:02.590262 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Getting quotas for user 124957514a4e4c35bed50a19de1dda6d and project 98f69056ca3e4e7c83f6c36c8e16c16c. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:56:02.648621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:56:02.650808 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='293d888c-2ec0-419a-a109-f8b04f7512b3',volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:56:03.056701 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c8bf6b27-f7e1-45b0-bd86-b90c9fa653c2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.291974 Jul 18 08:56:03.057386 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 517/1036] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:56:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 08:56:03.069006 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0b7232f8-8db7-463c-80ec-3434acd96c64 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:03.069710 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0b7232f8-8db7-463c-80ec-3434acd96c64 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:03.132858 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0b7232f8-8db7-463c-80ec-3434acd96c64 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:03.141529 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0b7232f8-8db7-463c-80ec-3434acd96c64 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1088 microversion: 2.1 time: 0.077103 Jul 18 08:56:03.142125 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 520/1037] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:03 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:56:04.159557 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1dc788c7-c250-4be9-be1e-eb4fbd861a7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:04.160241 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1dc788c7-c250-4be9-be1e-eb4fbd861a7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:04.215437 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1dc788c7-c250-4be9-be1e-eb4fbd861a7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:04.223558 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1dc788c7-c250-4be9-be1e-eb4fbd861a7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1088 microversion: 2.1 time: 0.068371 Jul 18 08:56:04.224181 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 518/1038] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:04 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:05.241943 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-fdf0d842-11ca-43b4-b7e1-ff75e86b2707 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:05.242624 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-fdf0d842-11ca-43b4-b7e1-ff75e86b2707 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:05.251059 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fdf0d842-11ca-43b4-b7e1-ff75e86b2707 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:05.251511 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fdf0d842-11ca-43b4-b7e1-ff75e86b2707 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:05.252315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fdf0d842-11ca-43b4-b7e1-ff75e86b2707 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:05.252758 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fdf0d842-11ca-43b4-b7e1-ff75e86b2707 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:05.316410 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-fdf0d842-11ca-43b4-b7e1-ff75e86b2707 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:05.324240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-fdf0d842-11ca-43b4-b7e1-ff75e86b2707 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1186 microversion: 2.1 time: 0.086397 Jul 18 08:56:05.324812 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 521/1039] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:05 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:06.344921 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-dc588c09-7689-40c5-9ca8-420bd12804cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:06.345593 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-dc588c09-7689-40c5-9ca8-420bd12804cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:06.353231 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dc588c09-7689-40c5-9ca8-420bd12804cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:06.353680 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dc588c09-7689-40c5-9ca8-420bd12804cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:06.354472 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dc588c09-7689-40c5-9ca8-420bd12804cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:06.354910 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-dc588c09-7689-40c5-9ca8-420bd12804cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:06.524282 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-dc588c09-7689-40c5-9ca8-420bd12804cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:06.533186 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-dc588c09-7689-40c5-9ca8-420bd12804cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1272 microversion: 2.1 time: 0.192421 Jul 18 08:56:06.534350 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 519/1040] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:06 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1272 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:07.293346 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-52b4597e-8beb-4941-bca6-6389d7db1ca5 req-4160b321-fb92-456f-a16b-5b7295c5e380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22289fae-ddb5-467d-a1e2-0e56a49398cb", "tag": "7e90d63d-9e1b-4274-b07d-aa12cb6b3c70"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:56:07.309774 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-52b4597e-8beb-4941-bca6-6389d7db1ca5 req-4160b321-fb92-456f-a16b-5b7295c5e380 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:07.313707 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-52b4597e-8beb-4941-bca6-6389d7db1ca5 req-4160b321-fb92-456f-a16b-5b7295c5e380 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:07.346306 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-52b4597e-8beb-4941-bca6-6389d7db1ca5 req-4160b321-fb92-456f-a16b-5b7295c5e380 service nova] Creating event network-changed:7e90d63d-9e1b-4274-b07d-aa12cb6b3c70 for instance 22289fae-ddb5-467d-a1e2-0e56a49398cb on hv-cinder-85014 Jul 18 08:56:07.352274 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-52b4597e-8beb-4941-bca6-6389d7db1ca5 req-4160b321-fb92-456f-a16b-5b7295c5e380 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068489 Jul 18 08:56:07.353283 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 522/1041] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:56:07.552748 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-488bcff7-9d04-49c8-ade0-14eead4eeced tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:07.552748 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-488bcff7-9d04-49c8-ade0-14eead4eeced tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:07.559935 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-488bcff7-9d04-49c8-ade0-14eead4eeced tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:07.560453 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-488bcff7-9d04-49c8-ade0-14eead4eeced tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:07.561485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-488bcff7-9d04-49c8-ade0-14eead4eeced tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:07.562053 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-488bcff7-9d04-49c8-ade0-14eead4eeced tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:07.737713 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-488bcff7-9d04-49c8-ade0-14eead4eeced tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:07.745566 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-488bcff7-9d04-49c8-ade0-14eead4eeced tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1272 microversion: 2.1 time: 0.198032 Jul 18 08:56:07.747520 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 520/1042] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:07 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:08.765015 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5ad42f8d-6d10-4bd6-8079-2c61a3e06565 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:08.765649 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5ad42f8d-6d10-4bd6-8079-2c61a3e06565 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:08.771875 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ad42f8d-6d10-4bd6-8079-2c61a3e06565 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:08.772324 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ad42f8d-6d10-4bd6-8079-2c61a3e06565 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:08.773080 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ad42f8d-6d10-4bd6-8079-2c61a3e06565 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:08.773513 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ad42f8d-6d10-4bd6-8079-2c61a3e06565 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:08.792066 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:08.906674 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5ad42f8d-6d10-4bd6-8079-2c61a3e06565 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:08.914159 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5ad42f8d-6d10-4bd6-8079-2c61a3e06565 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.154719 Jul 18 08:56:08.914729 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 523/1043] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:08 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:09.935158 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1e9cbf80-c232-4897-ac39-4b098cb98666 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:09.935888 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1e9cbf80-c232-4897-ac39-4b098cb98666 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:09.943013 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1e9cbf80-c232-4897-ac39-4b098cb98666 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:09.943470 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1e9cbf80-c232-4897-ac39-4b098cb98666 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:09.944278 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1e9cbf80-c232-4897-ac39-4b098cb98666 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:09.944718 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1e9cbf80-c232-4897-ac39-4b098cb98666 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:10.078400 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1e9cbf80-c232-4897-ac39-4b098cb98666 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:10.086040 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1e9cbf80-c232-4897-ac39-4b098cb98666 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.155369 Jul 18 08:56:10.086608 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 521/1044] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:09 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:11.107605 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-b985a6cd-6c49-4514-afb8-49ea64172198 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:11.108275 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-b985a6cd-6c49-4514-afb8-49ea64172198 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:11.115198 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b985a6cd-6c49-4514-afb8-49ea64172198 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:11.115631 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b985a6cd-6c49-4514-afb8-49ea64172198 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:11.116428 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b985a6cd-6c49-4514-afb8-49ea64172198 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:11.116860 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-b985a6cd-6c49-4514-afb8-49ea64172198 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:11.255466 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-b985a6cd-6c49-4514-afb8-49ea64172198 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:11.263818 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-b985a6cd-6c49-4514-afb8-49ea64172198 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.161243 Jul 18 08:56:11.264383 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 524/1045] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:11 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:12.280488 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1f388aaf-0926-40a6-b2eb-afc6b65960cd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:12.281104 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1f388aaf-0926-40a6-b2eb-afc6b65960cd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:12.287012 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1f388aaf-0926-40a6-b2eb-afc6b65960cd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:12.287486 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1f388aaf-0926-40a6-b2eb-afc6b65960cd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:12.288269 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1f388aaf-0926-40a6-b2eb-afc6b65960cd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:12.288711 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1f388aaf-0926-40a6-b2eb-afc6b65960cd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:12.426252 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1f388aaf-0926-40a6-b2eb-afc6b65960cd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:12.436367 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1f388aaf-0926-40a6-b2eb-afc6b65960cd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.160421 Jul 18 08:56:12.437103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 522/1046] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:12 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:13.454885 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-3dccb12e-809f-4bfb-b43d-2dd258c318ec tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:13.455492 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-3dccb12e-809f-4bfb-b43d-2dd258c318ec tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:13.457928 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:13.462847 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3dccb12e-809f-4bfb-b43d-2dd258c318ec tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:13.466546 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3dccb12e-809f-4bfb-b43d-2dd258c318ec tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:13.466546 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3dccb12e-809f-4bfb-b43d-2dd258c318ec tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:13.466546 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-3dccb12e-809f-4bfb-b43d-2dd258c318ec tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:13.598929 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-3dccb12e-809f-4bfb-b43d-2dd258c318ec tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:13.607255 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-3dccb12e-809f-4bfb-b43d-2dd258c318ec tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.156169 Jul 18 08:56:13.607849 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 525/1047] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:13 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:56:14.625105 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-54e690bd-5209-4411-ae38-cec968dc5d10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:14.625717 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-54e690bd-5209-4411-ae38-cec968dc5d10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:14.627563 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:14.628741 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=8 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:14.633942 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-54e690bd-5209-4411-ae38-cec968dc5d10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:14.634451 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-54e690bd-5209-4411-ae38-cec968dc5d10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:14.635217 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-54e690bd-5209-4411-ae38-cec968dc5d10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:14.635651 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-54e690bd-5209-4411-ae38-cec968dc5d10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:14.778351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-54e690bd-5209-4411-ae38-cec968dc5d10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:14.786274 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-54e690bd-5209-4411-ae38-cec968dc5d10 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.166291 Jul 18 08:56:14.786857 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 523/1048] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:14 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:15.804224 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0ca630ba-24ce-4063-b778-73f858658358 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:15.804838 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0ca630ba-24ce-4063-b778-73f858658358 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:15.818703 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ca630ba-24ce-4063-b778-73f858658358 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:15.819136 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ca630ba-24ce-4063-b778-73f858658358 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:15.819948 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ca630ba-24ce-4063-b778-73f858658358 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:15.820384 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0ca630ba-24ce-4063-b778-73f858658358 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:15.970137 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0ca630ba-24ce-4063-b778-73f858658358 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:15.977903 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0ca630ba-24ce-4063-b778-73f858658358 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.177630 Jul 18 08:56:15.978528 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 526/1049] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:15 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:56:16.995710 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9c5aa7a5-de18-4414-854d-7024124ab847 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:16.996638 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9c5aa7a5-de18-4414-854d-7024124ab847 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:17.003662 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9c5aa7a5-de18-4414-854d-7024124ab847 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:17.004181 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9c5aa7a5-de18-4414-854d-7024124ab847 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:17.005127 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9c5aa7a5-de18-4414-854d-7024124ab847 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:17.005567 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9c5aa7a5-de18-4414-854d-7024124ab847 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:17.137830 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9c5aa7a5-de18-4414-854d-7024124ab847 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:17.145507 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9c5aa7a5-de18-4414-854d-7024124ab847 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.153945 Jul 18 08:56:17.146075 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 524/1050] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:16 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:18.162717 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ed2fc766-cefb-4732-8117-3961d33e7b25 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:18.163282 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ed2fc766-cefb-4732-8117-3961d33e7b25 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:18.170441 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ed2fc766-cefb-4732-8117-3961d33e7b25 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:18.170886 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ed2fc766-cefb-4732-8117-3961d33e7b25 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:18.171645 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ed2fc766-cefb-4732-8117-3961d33e7b25 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:18.172101 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ed2fc766-cefb-4732-8117-3961d33e7b25 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:18.304597 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ed2fc766-cefb-4732-8117-3961d33e7b25 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:18.312848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ed2fc766-cefb-4732-8117-3961d33e7b25 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.153991 Jul 18 08:56:18.313421 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 527/1051] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:18 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:19.330621 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e00f201e-8550-4272-a5b6-b50401b7a2f3 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:19.331227 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e00f201e-8550-4272-a5b6-b50401b7a2f3 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:19.337806 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e00f201e-8550-4272-a5b6-b50401b7a2f3 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:19.338248 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e00f201e-8550-4272-a5b6-b50401b7a2f3 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:19.339002 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e00f201e-8550-4272-a5b6-b50401b7a2f3 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:19.339430 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e00f201e-8550-4272-a5b6-b50401b7a2f3 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:19.473282 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e00f201e-8550-4272-a5b6-b50401b7a2f3 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:19.480693 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e00f201e-8550-4272-a5b6-b50401b7a2f3 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.154000 Jul 18 08:56:19.481308 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 525/1052] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:19 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:20.499006 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-330ddd9d-20a4-4983-903f-bfb0a7a5e66b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:20.499619 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-330ddd9d-20a4-4983-903f-bfb0a7a5e66b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:20.501997 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=30 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:20.506832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-330ddd9d-20a4-4983-903f-bfb0a7a5e66b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:20.507292 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-330ddd9d-20a4-4983-903f-bfb0a7a5e66b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:20.508122 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-330ddd9d-20a4-4983-903f-bfb0a7a5e66b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:20.508564 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-330ddd9d-20a4-4983-903f-bfb0a7a5e66b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:20.657349 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-330ddd9d-20a4-4983-903f-bfb0a7a5e66b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:20.665117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-330ddd9d-20a4-4983-903f-bfb0a7a5e66b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.169992 Jul 18 08:56:20.665687 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 528/1053] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:20 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:21.682401 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0ad20213-8af9-456a-84fc-9ff02dbdfc3b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:21.683003 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0ad20213-8af9-456a-84fc-9ff02dbdfc3b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:21.690766 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ad20213-8af9-456a-84fc-9ff02dbdfc3b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:21.691221 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ad20213-8af9-456a-84fc-9ff02dbdfc3b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:21.692080 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ad20213-8af9-456a-84fc-9ff02dbdfc3b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:21.692510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0ad20213-8af9-456a-84fc-9ff02dbdfc3b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:21.827891 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0ad20213-8af9-456a-84fc-9ff02dbdfc3b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:21.835699 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0ad20213-8af9-456a-84fc-9ff02dbdfc3b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.157179 Jul 18 08:56:21.836553 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 526/1054] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:21 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:22.332313 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-b7345783-0b25-40ab-aea5-80a20f2ee8b4 req-92af044a-583f-4e3a-be67-1268d2d61097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22289fae-ddb5-467d-a1e2-0e56a49398cb", "name": "network-vif-plugged", "status": "completed", "tag": "7e90d63d-9e1b-4274-b07d-aa12cb6b3c70"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:56:22.341308 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-b7345783-0b25-40ab-aea5-80a20f2ee8b4 req-92af044a-583f-4e3a-be67-1268d2d61097 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:22.341939 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-b7345783-0b25-40ab-aea5-80a20f2ee8b4 req-92af044a-583f-4e3a-be67-1268d2d61097 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:22.354018 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-b7345783-0b25-40ab-aea5-80a20f2ee8b4 req-92af044a-583f-4e3a-be67-1268d2d61097 service nova] Creating event network-vif-plugged:7e90d63d-9e1b-4274-b07d-aa12cb6b3c70 for instance 22289fae-ddb5-467d-a1e2-0e56a49398cb on hv-cinder-85014 Jul 18 08:56:22.360829 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-b7345783-0b25-40ab-aea5-80a20f2ee8b4 req-92af044a-583f-4e3a-be67-1268d2d61097 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032474 Jul 18 08:56:22.361439 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 529/1055] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:56:22.852561 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b2de2b3a-b6f6-4f7a-a99f-e364763ce2f8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:22.853283 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b2de2b3a-b6f6-4f7a-a99f-e364763ce2f8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:22.860565 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b2de2b3a-b6f6-4f7a-a99f-e364763ce2f8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:22.861006 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b2de2b3a-b6f6-4f7a-a99f-e364763ce2f8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:22.861777 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b2de2b3a-b6f6-4f7a-a99f-e364763ce2f8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:22.862437 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b2de2b3a-b6f6-4f7a-a99f-e364763ce2f8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:22.994640 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b2de2b3a-b6f6-4f7a-a99f-e364763ce2f8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:23.003076 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b2de2b3a-b6f6-4f7a-a99f-e364763ce2f8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.154446 Jul 18 08:56:23.003645 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 527/1056] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:22 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:24.020856 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5ac803e0-d82d-49ab-8722-5c9b4fcfc55e tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:24.021551 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5ac803e0-d82d-49ab-8722-5c9b4fcfc55e tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:24.027935 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ac803e0-d82d-49ab-8722-5c9b4fcfc55e tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:24.028383 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ac803e0-d82d-49ab-8722-5c9b4fcfc55e tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:24.029644 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ac803e0-d82d-49ab-8722-5c9b4fcfc55e tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:24.030074 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ac803e0-d82d-49ab-8722-5c9b4fcfc55e tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:24.333064 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5ac803e0-d82d-49ab-8722-5c9b4fcfc55e tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:24.341050 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5ac803e0-d82d-49ab-8722-5c9b4fcfc55e tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1260 microversion: 2.1 time: 0.324942 Jul 18 08:56:24.342210 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 530/1057] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:24 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1260 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:24.768332 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e8e836b3-3505-455b-b994-dc940b97d0d0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:24.768871 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e8e836b3-3505-455b-b994-dc940b97d0d0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:24.775557 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e8e836b3-3505-455b-b994-dc940b97d0d0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:24.776041 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e8e836b3-3505-455b-b994-dc940b97d0d0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:24.776801 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e8e836b3-3505-455b-b994-dc940b97d0d0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:24.777245 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e8e836b3-3505-455b-b994-dc940b97d0d0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:24.962660 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-e8e836b3-3505-455b-b994-dc940b97d0d0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lazy-loading 'services' on Instance uuid 19b50d90-4a50-4c57-9a2f-67bc1f5ab177 {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:56:25.152091 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e8e836b3-3505-455b-b994-dc940b97d0d0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "DELETE /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177/os-volume_attachments/f79fa664-ed83-4e71-a830-10703b10ab4d" status: 202 len: 0 microversion: 2.1 time: 0.388329 Jul 18 08:56:25.152671 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 528/1058] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:56:24 2022] DELETE /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177/os-volume_attachments/f79fa664-ed83-4e71-a830-10703b10ab4d => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:56:25.359097 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-502a5dad-2433-41f6-be79-e8aaa384d286 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:25.359771 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-502a5dad-2433-41f6-be79-e8aaa384d286 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:25.366418 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-502a5dad-2433-41f6-be79-e8aaa384d286 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:25.366865 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-502a5dad-2433-41f6-be79-e8aaa384d286 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:25.367658 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-502a5dad-2433-41f6-be79-e8aaa384d286 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:25.368125 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-502a5dad-2433-41f6-be79-e8aaa384d286 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:25.503328 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-502a5dad-2433-41f6-be79-e8aaa384d286 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:25.510559 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-502a5dad-2433-41f6-be79-e8aaa384d286 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1444 microversion: 2.1 time: 0.155701 Jul 18 08:56:25.511136 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 531/1059] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:25 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:25.527847 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-12fab0ae-cbc9-45e1-8508-1c9423fc0ecd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:25.528555 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-12fab0ae-cbc9-45e1-8508-1c9423fc0ecd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:25.535199 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-12fab0ae-cbc9-45e1-8508-1c9423fc0ecd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:25.535641 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-12fab0ae-cbc9-45e1-8508-1c9423fc0ecd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:25.536437 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-12fab0ae-cbc9-45e1-8508-1c9423fc0ecd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:25.536860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-12fab0ae-cbc9-45e1-8508-1c9423fc0ecd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:25.674877 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-12fab0ae-cbc9-45e1-8508-1c9423fc0ecd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:25.683102 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-12fab0ae-cbc9-45e1-8508-1c9423fc0ecd tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1444 microversion: 2.1 time: 0.159483 Jul 18 08:56:25.683689 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 529/1060] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:25 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:26.268357 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c8b6f186-4c99-469e-887b-aacf95c63e45 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:26.268988 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c8b6f186-4c99-469e-887b-aacf95c63e45 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:26.274986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8b6f186-4c99-469e-887b-aacf95c63e45 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:26.275443 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8b6f186-4c99-469e-887b-aacf95c63e45 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:26.276420 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8b6f186-4c99-469e-887b-aacf95c63e45 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:26.277033 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c8b6f186-4c99-469e-887b-aacf95c63e45 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:26.303584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c8b6f186-4c99-469e-887b-aacf95c63e45 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:56:26.649552 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c8b6f186-4c99-469e-887b-aacf95c63e45 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "DELETE /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 204 len: 0 microversion: 2.1 time: 0.384772 Jul 18 08:56:26.650271 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 532/1061] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:56:26 2022] DELETE /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:56:26.658587 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b008d1d9-7b59-4a86-9b04-b2a2340b28be tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:26.659834 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b008d1d9-7b59-4a86-9b04-b2a2340b28be tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:26.667381 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b008d1d9-7b59-4a86-9b04-b2a2340b28be tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:26.668183 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b008d1d9-7b59-4a86-9b04-b2a2340b28be tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:26.668981 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b008d1d9-7b59-4a86-9b04-b2a2340b28be tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:26.669899 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b008d1d9-7b59-4a86-9b04-b2a2340b28be tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:26.876769 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b008d1d9-7b59-4a86-9b04-b2a2340b28be tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:26.884335 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b008d1d9-7b59-4a86-9b04-b2a2340b28be tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1514 microversion: 2.1 time: 0.229626 Jul 18 08:56:26.893896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 530/1062] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:26 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:27.903026 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-fdb03277-eff9-4085-baaf-d67f51b70565 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:27.903790 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-fdb03277-eff9-4085-baaf-d67f51b70565 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:27.910582 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fdb03277-eff9-4085-baaf-d67f51b70565 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:27.911046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fdb03277-eff9-4085-baaf-d67f51b70565 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:27.911849 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fdb03277-eff9-4085-baaf-d67f51b70565 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:27.912290 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fdb03277-eff9-4085-baaf-d67f51b70565 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:28.052024 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-fdb03277-eff9-4085-baaf-d67f51b70565 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:28.061184 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-fdb03277-eff9-4085-baaf-d67f51b70565 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1514 microversion: 2.1 time: 0.161715 Jul 18 08:56:28.062475 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 533/1063] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:27 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:28.215689 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-5e51da6b-b680-416d-8e52-a849e0ff2855 req-2b5f2192-6c07-4130-8b36-5252255dda39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22289fae-ddb5-467d-a1e2-0e56a49398cb", "tag": "7e90d63d-9e1b-4274-b07d-aa12cb6b3c70"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:56:28.224949 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-5e51da6b-b680-416d-8e52-a849e0ff2855 req-2b5f2192-6c07-4130-8b36-5252255dda39 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:28.225396 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-5e51da6b-b680-416d-8e52-a849e0ff2855 req-2b5f2192-6c07-4130-8b36-5252255dda39 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:28.239031 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-5e51da6b-b680-416d-8e52-a849e0ff2855 req-2b5f2192-6c07-4130-8b36-5252255dda39 service nova] Creating event network-changed:7e90d63d-9e1b-4274-b07d-aa12cb6b3c70 for instance 22289fae-ddb5-467d-a1e2-0e56a49398cb on hv-cinder-85014 Jul 18 08:56:28.243586 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-5e51da6b-b680-416d-8e52-a849e0ff2855 req-2b5f2192-6c07-4130-8b36-5252255dda39 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031527 Jul 18 08:56:28.246191 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 531/1064] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:56:29.078791 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bacc9e5e-4b31-41e6-b551-01209348c9f0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:29.079424 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bacc9e5e-4b31-41e6-b551-01209348c9f0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:29.086936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bacc9e5e-4b31-41e6-b551-01209348c9f0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:29.087404 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bacc9e5e-4b31-41e6-b551-01209348c9f0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:29.088202 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bacc9e5e-4b31-41e6-b551-01209348c9f0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:29.088646 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bacc9e5e-4b31-41e6-b551-01209348c9f0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:29.122595 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bacc9e5e-4b31-41e6-b551-01209348c9f0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:29.122979 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bacc9e5e-4b31-41e6-b551-01209348c9f0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:29.123437 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-bacc9e5e-4b31-41e6-b551-01209348c9f0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lazy-loading 'fault' on Instance uuid 19b50d90-4a50-4c57-9a2f-67bc1f5ab177 {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:56:29.166962 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-bacc9e5e-4b31-41e6-b551-01209348c9f0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:29.175554 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bacc9e5e-4b31-41e6-b551-01209348c9f0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 200 len: 1309 microversion: 2.1 time: 0.100687 Jul 18 08:56:29.176168 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 534/1065] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:29 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:30.199727 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d51f8824-2b0e-4525-81b0-1336bd35e838 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:30.200422 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d51f8824-2b0e-4525-81b0-1336bd35e838 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 19b50d90-4a50-4c57-9a2f-67bc1f5ab177] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:30.206618 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d51f8824-2b0e-4525-81b0-1336bd35e838 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:30.207057 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d51f8824-2b0e-4525-81b0-1336bd35e838 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:30.207837 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d51f8824-2b0e-4525-81b0-1336bd35e838 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:30.208270 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d51f8824-2b0e-4525-81b0-1336bd35e838 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:30.221479 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-d51f8824-2b0e-4525-81b0-1336bd35e838 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] HTTP exception thrown: Instance 19b50d90-4a50-4c57-9a2f-67bc1f5ab177 could not be found. Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d51f8824-2b0e-4525-81b0-1336bd35e838 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Request method failure captured: Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 HTTP/1.1 Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R_ygbPcXQvG_Q3Lka0etxmHPaLsD4I2o-vR5NB3x3LIMZBctNnggf5R0dfYcyy_EnXdplrv3l56-eRiL_UUpkHJvjIitzVB-0ZU7MvyzFtmjI3DNL9v9_2czj_kR2YS-ZiH5JmYhZSlzIIT4WbTMSg4qFXaqpCAOPbOZjNUcqUht94 Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: 3df75aa755784fee814abfd669ce02da Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-VolumesSnapshotTestJSON-938010684 Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:56:30.223099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3df75aa755784fee814abfd669ce02da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3df75aa755784fee814abfd669ce02da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3df75aa755784fee814abfd669ce02da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3df75aa755784fee814abfd669ce02da", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-VolumesSnapshotTestJSON-938010684 Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: 3df75aa755784fee814abfd669ce02da Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-938010684 Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-VolumesSnapshotTestJSON-938010684-project Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: b9f08551f4ff4bbd9c48c438a518c8d0 Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-VolumesSnapshotTestJSON-938010684-project Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance 19b50d90-4a50-4c57-9a2f-67bc1f5ab177 could not be found. Jul 18 08:56:30.225201 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': '19b50d90-4a50-4c57-9a2f-67bc1f5ab177'} Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b50d90-4a50-4c57-9a2f-67bc1f5ab177 could not be found. Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:56:30.226195 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b50d90-4a50-4c57-9a2f-67bc1f5ab177 could not be found. Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b50d90-4a50-4c57-9a2f-67bc1f5ab177 could not be found. Jul 18 08:56:30.227759 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:56:30.229383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d51f8824-2b0e-4525-81b0-1336bd35e838 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Returning 404 to user: Instance 19b50d90-4a50-4c57-9a2f-67bc1f5ab177 could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:56:30.229383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d51f8824-2b0e-4525-81b0-1336bd35e838 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177" status: 404 len: 111 microversion: 2.1 time: 0.029827 Jul 18 08:56:30.229383 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 532/1066] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:30 2022] GET /compute/v2.1/servers/19b50d90-4a50-4c57-9a2f-67bc1f5ab177 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:56:30.259815 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-9708b015-0c88-4b60-8ef6-cce80b45612f req-2bbb5382-e7f4-4e32-b217-ddb81dd4bd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b50d90-4a50-4c57-9a2f-67bc1f5ab177", "name": "network-vif-deleted", "tag": "7161b4e3-57c9-4794-951c-1f8c38b0dad1"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:56:30.268303 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-9708b015-0c88-4b60-8ef6-cce80b45612f req-2bbb5382-e7f4-4e32-b217-ddb81dd4bd13 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:30.268746 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-9708b015-0c88-4b60-8ef6-cce80b45612f req-2bbb5382-e7f4-4e32-b217-ddb81dd4bd13 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:30.279608 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-9708b015-0c88-4b60-8ef6-cce80b45612f req-2bbb5382-e7f4-4e32-b217-ddb81dd4bd13 service nova] Creating event network-vif-deleted:7161b4e3-57c9-4794-951c-1f8c38b0dad1 for instance 19b50d90-4a50-4c57-9a2f-67bc1f5ab177 on hv-cinder-85014 Jul 18 08:56:30.284538 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-9708b015-0c88-4b60-8ef6-cce80b45612f req-2bbb5382-e7f4-4e32-b217-ddb81dd4bd13 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028378 Jul 18 08:56:30.285147 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 535/1067] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:56:40.885686 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2096145655", "imageRef": "07130047-9d01-4ed7-949c-35730e2685db", "flavorRef": "452", "networks": [{"uuid": "00784d3b-b117-422c-8519-5074d6c7ced6"}]}} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:56:40.893446 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:40.894106 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:40.947351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.network.neutron [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] validate_networks() for [('00784d3b-b117-422c-8519-5074d6c7ced6', None, None, None, None, None)] {{(pid=124895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 08:56:41.324081 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Flavor limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 08:56:41.324502 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Image limits 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 08:56:41.324962 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Flavor pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 08:56:41.325396 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Image pref 0:0:0 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 08:56:41.325798 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.virt.hardware [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 08:56:41.334685 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:41.335056 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:41.335896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:41.336376 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:41.353236 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Getting quotas for project 3df75aa755784fee814abfd669ce02da. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 08:56:41.357078 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.quota [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Getting quotas for user b9f08551f4ff4bbd9c48c438a518c8d0 and project 3df75aa755784fee814abfd669ce02da. Resources: {'instances', 'ram', 'cores'} {{(pid=124895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 08:56:41.368922 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Going to run 1 instances... {{(pid=124895) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 08:56:41.371251 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07130047-9d01-4ed7-949c-35730e2685db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 08:56:41.503126 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-bbcb62f2-c694-42a7-868c-c8ca524a4dcd tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621524 Jul 18 08:56:41.503802 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 533/1068] 10.222.0.57 () {60 vars in 1146 bytes} [Mon Jul 18 08:56:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 08:56:41.511994 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:41.512772 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:41.517089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-95f8b2ca-e5f8-4ee7-896c-495cc96f1b81 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:41.524718 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-95f8b2ca-e5f8-4ee7-896c-495cc96f1b81 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:41.574214 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-95f8b2ca-e5f8-4ee7-896c-495cc96f1b81 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:41.581471 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-95f8b2ca-e5f8-4ee7-896c-495cc96f1b81 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1219 microversion: 2.1 time: 0.071257 Jul 18 08:56:41.582046 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 536/1069] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:41 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:42.599374 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-9188b0f7-cea7-49c3-ae40-ee76b5f4d515 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:42.600008 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-9188b0f7-cea7-49c3-ae40-ee76b5f4d515 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:42.606393 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9188b0f7-cea7-49c3-ae40-ee76b5f4d515 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:42.606849 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9188b0f7-cea7-49c3-ae40-ee76b5f4d515 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:42.607620 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9188b0f7-cea7-49c3-ae40-ee76b5f4d515 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:42.608102 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-9188b0f7-cea7-49c3-ae40-ee76b5f4d515 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:42.672741 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-9188b0f7-cea7-49c3-ae40-ee76b5f4d515 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:42.681117 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-9188b0f7-cea7-49c3-ae40-ee76b5f4d515 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1223 microversion: 2.1 time: 0.086422 Jul 18 08:56:42.681688 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 534/1070] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:42 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:56:43.699058 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0f9b98a9-3dbd-487f-a6ca-579e1bad5484 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:43.699777 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0f9b98a9-3dbd-487f-a6ca-579e1bad5484 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:43.708526 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0f9b98a9-3dbd-487f-a6ca-579e1bad5484 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:43.708981 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0f9b98a9-3dbd-487f-a6ca-579e1bad5484 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:43.709759 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0f9b98a9-3dbd-487f-a6ca-579e1bad5484 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:43.710211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0f9b98a9-3dbd-487f-a6ca-579e1bad5484 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:43.783132 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0f9b98a9-3dbd-487f-a6ca-579e1bad5484 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:43.791941 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0f9b98a9-3dbd-487f-a6ca-579e1bad5484 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1289 microversion: 2.1 time: 0.097266 Jul 18 08:56:43.792729 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 537/1071] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:43 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:44.810062 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-b930e531-54b4-41a1-b000-c90c40a7e770 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:44.810705 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-b930e531-54b4-41a1-b000-c90c40a7e770 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:44.818528 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b930e531-54b4-41a1-b000-c90c40a7e770 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:44.818976 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b930e531-54b4-41a1-b000-c90c40a7e770 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:44.819780 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b930e531-54b4-41a1-b000-c90c40a7e770 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:44.820227 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-b930e531-54b4-41a1-b000-c90c40a7e770 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:44.964031 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-b930e531-54b4-41a1-b000-c90c40a7e770 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:44.971327 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-b930e531-54b4-41a1-b000-c90c40a7e770 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1319 microversion: 2.1 time: 0.164491 Jul 18 08:56:44.972337 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 535/1072] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:44 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:45.351560 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-dbc6a1e8-77aa-411d-84c4-0462c488d314 req-23b6a683-69c2-460c-a97d-eaf1ed8bf9ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f5167d-4223-41f6-bebf-7471ae56721f", "tag": "3f7e28e2-a717-4d40-9d0c-fefe3c3a1913"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:56:45.359939 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-dbc6a1e8-77aa-411d-84c4-0462c488d314 req-23b6a683-69c2-460c-a97d-eaf1ed8bf9ae service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:45.360491 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-dbc6a1e8-77aa-411d-84c4-0462c488d314 req-23b6a683-69c2-460c-a97d-eaf1ed8bf9ae service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:45.371706 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-dbc6a1e8-77aa-411d-84c4-0462c488d314 req-23b6a683-69c2-460c-a97d-eaf1ed8bf9ae service nova] Creating event network-changed:3f7e28e2-a717-4d40-9d0c-fefe3c3a1913 for instance 27f5167d-4223-41f6-bebf-7471ae56721f on hv-cinder-85014 Jul 18 08:56:45.378036 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-dbc6a1e8-77aa-411d-84c4-0462c488d314 req-23b6a683-69c2-460c-a97d-eaf1ed8bf9ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095883 Jul 18 08:56:45.379023 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 538/1073] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:56:45.989205 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f9c07932-e7e2-469a-93ee-bf1d3d3cb67d tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:45.989844 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f9c07932-e7e2-469a-93ee-bf1d3d3cb67d tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:45.996645 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f9c07932-e7e2-469a-93ee-bf1d3d3cb67d tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:45.997088 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f9c07932-e7e2-469a-93ee-bf1d3d3cb67d tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:45.997863 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f9c07932-e7e2-469a-93ee-bf1d3d3cb67d tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:45.998301 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f9c07932-e7e2-469a-93ee-bf1d3d3cb67d tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:46.141143 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f9c07932-e7e2-469a-93ee-bf1d3d3cb67d tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:46.149832 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f9c07932-e7e2-469a-93ee-bf1d3d3cb67d tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1319 microversion: 2.1 time: 0.165476 Jul 18 08:56:46.150421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 536/1074] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:45 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:47.169101 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-27c97cd7-0a70-4965-bc69-fc494b34232b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:47.169742 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-27c97cd7-0a70-4965-bc69-fc494b34232b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:47.176845 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-27c97cd7-0a70-4965-bc69-fc494b34232b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:47.177296 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-27c97cd7-0a70-4965-bc69-fc494b34232b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:47.178076 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-27c97cd7-0a70-4965-bc69-fc494b34232b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:47.178515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-27c97cd7-0a70-4965-bc69-fc494b34232b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:47.326133 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-27c97cd7-0a70-4965-bc69-fc494b34232b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:47.334179 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-27c97cd7-0a70-4965-bc69-fc494b34232b tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1319 microversion: 2.1 time: 0.169833 Jul 18 08:56:47.334766 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 539/1075] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:47 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:48.350585 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-f810e487-d788-473e-a3bc-95ee19e7efb3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:48.351239 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-f810e487-d788-473e-a3bc-95ee19e7efb3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:48.357946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f810e487-d788-473e-a3bc-95ee19e7efb3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:48.358397 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f810e487-d788-473e-a3bc-95ee19e7efb3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:48.359194 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f810e487-d788-473e-a3bc-95ee19e7efb3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:48.359738 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-f810e487-d788-473e-a3bc-95ee19e7efb3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:48.510765 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-f810e487-d788-473e-a3bc-95ee19e7efb3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:48.523128 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-f810e487-d788-473e-a3bc-95ee19e7efb3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1319 microversion: 2.1 time: 0.176117 Jul 18 08:56:48.524209 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 537/1076] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:48 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:49.546318 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-955828b8-938a-45a8-ba9a-c3440d8532f8 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:49.546946 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-955828b8-938a-45a8-ba9a-c3440d8532f8 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:49.553997 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-955828b8-938a-45a8-ba9a-c3440d8532f8 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:49.565267 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-955828b8-938a-45a8-ba9a-c3440d8532f8 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:49.565267 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-955828b8-938a-45a8-ba9a-c3440d8532f8 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:49.565267 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-955828b8-938a-45a8-ba9a-c3440d8532f8 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:49.693177 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-955828b8-938a-45a8-ba9a-c3440d8532f8 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:49.701220 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-955828b8-938a-45a8-ba9a-c3440d8532f8 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1319 microversion: 2.1 time: 0.158735 Jul 18 08:56:49.701848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 540/1077] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:49 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:50.719354 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1cc2fe4a-1a26-4200-9602-7d3cfb36f22e tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:50.720031 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1cc2fe4a-1a26-4200-9602-7d3cfb36f22e tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:50.726982 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1cc2fe4a-1a26-4200-9602-7d3cfb36f22e tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:50.727435 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1cc2fe4a-1a26-4200-9602-7d3cfb36f22e tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:50.728261 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1cc2fe4a-1a26-4200-9602-7d3cfb36f22e tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:50.728698 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1cc2fe4a-1a26-4200-9602-7d3cfb36f22e tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:50.875268 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1cc2fe4a-1a26-4200-9602-7d3cfb36f22e tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:50.883851 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1cc2fe4a-1a26-4200-9602-7d3cfb36f22e tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1319 microversion: 2.1 time: 0.169235 Jul 18 08:56:50.884534 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 538/1078] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:50 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:51.901844 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e2c3675e-d62c-4af5-9f1d-e616552f5f02 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:51.902447 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e2c3675e-d62c-4af5-9f1d-e616552f5f02 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:51.904953 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell0:SELECT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:51.910675 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e2c3675e-d62c-4af5-9f1d-e616552f5f02 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:51.911121 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e2c3675e-d62c-4af5-9f1d-e616552f5f02 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:51.911912 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e2c3675e-d62c-4af5-9f1d-e616552f5f02 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:51.912349 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e2c3675e-d62c-4af5-9f1d-e616552f5f02 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:52.049401 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e2c3675e-d62c-4af5-9f1d-e616552f5f02 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:52.057170 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e2c3675e-d62c-4af5-9f1d-e616552f5f02 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1319 microversion: 2.1 time: 0.159156 Jul 18 08:56:52.057752 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 541/1079] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:51 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:52.536735 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-fcbb6837-0c35-44db-86e7-d234d9d4676d req-3f153735-735d-43a2-9f64-45cb14e1d991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f5167d-4223-41f6-bebf-7471ae56721f", "name": "network-vif-plugged", "status": "completed", "tag": "3f7e28e2-a717-4d40-9d0c-fefe3c3a1913"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:56:52.540545 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=2 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:52.541212 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell0:SELECT=6 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:56:52.547844 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-fcbb6837-0c35-44db-86e7-d234d9d4676d req-3f153735-735d-43a2-9f64-45cb14e1d991 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:52.548293 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-fcbb6837-0c35-44db-86e7-d234d9d4676d req-3f153735-735d-43a2-9f64-45cb14e1d991 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:52.560976 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-fcbb6837-0c35-44db-86e7-d234d9d4676d req-3f153735-735d-43a2-9f64-45cb14e1d991 service nova] Creating event network-vif-plugged:3f7e28e2-a717-4d40-9d0c-fefe3c3a1913 for instance 27f5167d-4223-41f6-bebf-7471ae56721f on hv-cinder-85014 Jul 18 08:56:52.567345 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-fcbb6837-0c35-44db-86e7-d234d9d4676d req-3f153735-735d-43a2-9f64-45cb14e1d991 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034880 Jul 18 08:56:52.568172 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 539/1080] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:56:53.074896 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-31fd8ce1-7347-4879-8a9c-4064d6475ac3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:53.075513 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-31fd8ce1-7347-4879-8a9c-4064d6475ac3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:53.082823 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-31fd8ce1-7347-4879-8a9c-4064d6475ac3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:53.083280 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-31fd8ce1-7347-4879-8a9c-4064d6475ac3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:53.084082 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-31fd8ce1-7347-4879-8a9c-4064d6475ac3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:53.084558 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-31fd8ce1-7347-4879-8a9c-4064d6475ac3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:53.218268 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-31fd8ce1-7347-4879-8a9c-4064d6475ac3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:53.226370 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-31fd8ce1-7347-4879-8a9c-4064d6475ac3 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1319 microversion: 2.1 time: 0.155828 Jul 18 08:56:53.226940 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 542/1081] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:53 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:54.244751 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-0b3b8945-3856-4ffb-b476-ad3a86e96239 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:56:54.245445 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-0b3b8945-3856-4ffb-b476-ad3a86e96239 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:54.252091 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b3b8945-3856-4ffb-b476-ad3a86e96239 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:54.252554 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b3b8945-3856-4ffb-b476-ad3a86e96239 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:54.253294 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b3b8945-3856-4ffb-b476-ad3a86e96239 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:54.253768 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-0b3b8945-3856-4ffb-b476-ad3a86e96239 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:54.397947 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-0b3b8945-3856-4ffb-b476-ad3a86e96239 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:56:54.405567 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-0b3b8945-3856-4ffb-b476-ad3a86e96239 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1509 microversion: 2.1 time: 0.166853 Jul 18 08:56:54.406134 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 540/1082] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:56:54 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:56:54.422259 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-c066669b-2ebe-4a8f-ae54-a24b42da5a44 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26c92bf1-eab4-429d-a9cb-07681f500cd6", "device": "/dev/sdb"}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:56:54.423350 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-c066669b-2ebe-4a8f-ae54-a24b42da5a44 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:56:54.430713 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c066669b-2ebe-4a8f-ae54-a24b42da5a44 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:54.431170 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c066669b-2ebe-4a8f-ae54-a24b42da5a44 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:54.432180 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c066669b-2ebe-4a8f-ae54-a24b42da5a44 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:56:54.433425 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-c066669b-2ebe-4a8f-ae54-a24b42da5a44 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:56:55.188297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-c066669b-2ebe-4a8f-ae54-a24b42da5a44 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "POST /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.769879 Jul 18 08:56:55.188908 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 543/1083] 10.222.0.57 () {60 vars in 1322 bytes} [Mon Jul 18 08:56:54 2022] POST /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f/os-volume_attachments => generated 194 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:57:15.244508 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ff122b6b-47d3-49bf-81b3-25c1b3c3215a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:15.245046 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ff122b6b-47d3-49bf-81b3-25c1b3c3215a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:15.246994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:15.247853 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=40 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:15.252661 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ff122b6b-47d3-49bf-81b3-25c1b3c3215a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:15.253105 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ff122b6b-47d3-49bf-81b3-25c1b3c3215a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:15.253907 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ff122b6b-47d3-49bf-81b3-25c1b3c3215a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:15.254339 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ff122b6b-47d3-49bf-81b3-25c1b3c3215a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:15.334373 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.objects.instance [None req-ff122b6b-47d3-49bf-81b3-25c1b3c3215a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lazy-loading 'services' on Instance uuid 27f5167d-4223-41f6-bebf-7471ae56721f {{(pid=124895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:57:15.551066 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ff122b6b-47d3-49bf-81b3-25c1b3c3215a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "DELETE /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f/os-volume_attachments/26c92bf1-eab4-429d-a9cb-07681f500cd6" status: 202 len: 0 microversion: 2.1 time: 0.310522 Jul 18 08:57:15.551587 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 541/1084] 10.222.0.57 () {58 vars in 1415 bytes} [Mon Jul 18 08:57:15 2022] DELETE /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f/os-volume_attachments/26c92bf1-eab4-429d-a9cb-07681f500cd6 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:57:16.664036 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=18 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:16.665416 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:16.671217 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-88145774-70ba-4364-8037-319ac085ce12 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:16.671832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-88145774-70ba-4364-8037-319ac085ce12 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:16.677923 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-88145774-70ba-4364-8037-319ac085ce12 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:16.678379 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-88145774-70ba-4364-8037-319ac085ce12 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:16.679145 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-88145774-70ba-4364-8037-319ac085ce12 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:16.679589 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-88145774-70ba-4364-8037-319ac085ce12 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:16.706456 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-88145774-70ba-4364-8037-319ac085ce12 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:57:16.983525 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-88145774-70ba-4364-8037-319ac085ce12 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "DELETE /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 204 len: 0 microversion: 2.1 time: 0.321632 Jul 18 08:57:16.984173 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 544/1085] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:57:16 2022] DELETE /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:57:16.993404 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4352446a-9bb2-4560-a299-0303ec0b8112 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:16.998309 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-4352446a-9bb2-4560-a299-0303ec0b8112 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:17.000577 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4352446a-9bb2-4560-a299-0303ec0b8112 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:17.001032 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4352446a-9bb2-4560-a299-0303ec0b8112 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:17.001803 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4352446a-9bb2-4560-a299-0303ec0b8112 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:17.002243 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4352446a-9bb2-4560-a299-0303ec0b8112 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:17.132496 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4352446a-9bb2-4560-a299-0303ec0b8112 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:57:17.140295 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-4352446a-9bb2-4560-a299-0303ec0b8112 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1515 microversion: 2.1 time: 0.151578 Jul 18 08:57:17.140867 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 542/1086] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:16 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:57:18.158795 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-115f133a-b2fe-4acd-9f27-b5b0cc9873c0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:18.159450 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-115f133a-b2fe-4acd-9f27-b5b0cc9873c0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:18.166241 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-115f133a-b2fe-4acd-9f27-b5b0cc9873c0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:18.166691 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-115f133a-b2fe-4acd-9f27-b5b0cc9873c0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:18.167555 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-115f133a-b2fe-4acd-9f27-b5b0cc9873c0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:18.168032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-115f133a-b2fe-4acd-9f27-b5b0cc9873c0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:18.303421 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-115f133a-b2fe-4acd-9f27-b5b0cc9873c0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:57:18.309032 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-115f133a-b2fe-4acd-9f27-b5b0cc9873c0 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1515 microversion: 2.1 time: 0.154471 Jul 18 08:57:18.309612 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 545/1087] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:18 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:57:19.180493 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-8a9c1aff-5519-437e-bef5-a481ad2fcca1 req-4f5f6ea4-690a-4262-a551-c6bfef8f3eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f5167d-4223-41f6-bebf-7471ae56721f", "name": "network-vif-deleted", "tag": "3f7e28e2-a717-4d40-9d0c-fefe3c3a1913"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:57:19.189502 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-8a9c1aff-5519-437e-bef5-a481ad2fcca1 req-4f5f6ea4-690a-4262-a551-c6bfef8f3eeb service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:19.190010 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-8a9c1aff-5519-437e-bef5-a481ad2fcca1 req-4f5f6ea4-690a-4262-a551-c6bfef8f3eeb service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:19.201906 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-8a9c1aff-5519-437e-bef5-a481ad2fcca1 req-4f5f6ea4-690a-4262-a551-c6bfef8f3eeb service nova] Creating event network-vif-deleted:3f7e28e2-a717-4d40-9d0c-fefe3c3a1913 for instance 27f5167d-4223-41f6-bebf-7471ae56721f on hv-cinder-85014 Jul 18 08:57:19.206840 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-8a9c1aff-5519-437e-bef5-a481ad2fcca1 req-4f5f6ea4-690a-4262-a551-c6bfef8f3eeb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030124 Jul 18 08:57:19.207416 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 543/1088] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:57:19.327205 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7cacd3a8-f790-485c-82bd-7a7851b1d889 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:19.327951 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7cacd3a8-f790-485c-82bd-7a7851b1d889 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:19.334497 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7cacd3a8-f790-485c-82bd-7a7851b1d889 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:19.334954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7cacd3a8-f790-485c-82bd-7a7851b1d889 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:19.335747 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7cacd3a8-f790-485c-82bd-7a7851b1d889 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:19.336190 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7cacd3a8-f790-485c-82bd-7a7851b1d889 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:19.412426 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7cacd3a8-f790-485c-82bd-7a7851b1d889 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9f08551f4ff4bbd9c48c438a518c8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3df75aa755784fee814abfd669ce02da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:57:19.420807 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7cacd3a8-f790-485c-82bd-7a7851b1d889 tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 200 len: 1304 microversion: 2.1 time: 0.098244 Jul 18 08:57:19.421389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 546/1089] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:19 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:57:20.439283 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6311e427-2951-4358-8788-ec496714051a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:20.440015 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-6311e427-2951-4358-8788-ec496714051a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] [instance: 27f5167d-4223-41f6-bebf-7471ae56721f] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:20.446524 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6311e427-2951-4358-8788-ec496714051a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:20.447343 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6311e427-2951-4358-8788-ec496714051a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:20.448151 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6311e427-2951-4358-8788-ec496714051a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:20.448595 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-6311e427-2951-4358-8788-ec496714051a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:20.461971 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-6311e427-2951-4358-8788-ec496714051a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] HTTP exception thrown: Instance 27f5167d-4223-41f6-bebf-7471ae56721f could not be found. Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6311e427-2951-4358-8788-ec496714051a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Request method failure captured: Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f HTTP/1.1 Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R_ygbPcXQvG_Q3Lka0etxmHPaLsD4I2o-vR5NB3x3LIMZBctNnggf5R0dfYcyy_EnXdplrv3l56-eRiL_UUpkHJvjIitzVB-0ZU7MvyzFtmjI3DNL9v9_2czj_kR2YS-ZiH5JmYhZSlzIIT4WbTMSg4qFXaqpCAOPbOZjNUcqUht94 Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: 3df75aa755784fee814abfd669ce02da Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-VolumesSnapshotTestJSON-938010684 Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:57:20.463757 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3df75aa755784fee814abfd669ce02da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3df75aa755784fee814abfd669ce02da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3df75aa755784fee814abfd669ce02da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3df75aa755784fee814abfd669ce02da", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-VolumesSnapshotTestJSON-938010684 Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: 3df75aa755784fee814abfd669ce02da Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-938010684 Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-VolumesSnapshotTestJSON-938010684-project Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: b9f08551f4ff4bbd9c48c438a518c8d0 Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-VolumesSnapshotTestJSON-938010684-project Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance 27f5167d-4223-41f6-bebf-7471ae56721f could not be found. Jul 18 08:57:20.465485 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': '27f5167d-4223-41f6-bebf-7471ae56721f'} Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27f5167d-4223-41f6-bebf-7471ae56721f could not be found. Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:57:20.466517 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27f5167d-4223-41f6-bebf-7471ae56721f could not be found. Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27f5167d-4223-41f6-bebf-7471ae56721f could not be found. Jul 18 08:57:20.467896 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:57:20.469314 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-6311e427-2951-4358-8788-ec496714051a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] Returning 404 to user: Instance 27f5167d-4223-41f6-bebf-7471ae56721f could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:57:20.469314 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-6311e427-2951-4358-8788-ec496714051a tempest-VolumesSnapshotTestJSON-938010684 tempest-VolumesSnapshotTestJSON-938010684-project] 10.222.0.57 "GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f" status: 404 len: 111 microversion: 2.1 time: 0.030522 Jul 18 08:57:20.469314 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 544/1090] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:20 2022] GET /compute/v2.1/servers/27f5167d-4223-41f6-bebf-7471ae56721f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:57:33.521277 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-1cf91235-4362-48af-bd59-27e1b73085e8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:33.521822 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1cf91235-4362-48af-bd59-27e1b73085e8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:33.524448 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:33.525112 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:33.525333 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [req-84ca5b0b-948d-47a6-b46a-029d53cd09a5 req-40869929-9964-4cd0-9ec6-59b4dc1a3e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f97e59a-6d5c-465e-91a7-479df09355e9", "tag": "649f5ff3-9ef1-4a08-9cee-a5b3ce52f527"}]} {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:57:33.530249 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1cf91235-4362-48af-bd59-27e1b73085e8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:33.530613 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=8 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:33.530750 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1cf91235-4362-48af-bd59-27e1b73085e8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:33.531515 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1cf91235-4362-48af-bd59-27e1b73085e8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:33.531935 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:57:33.532073 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-1cf91235-4362-48af-bd59-27e1b73085e8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:33.538135 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-84ca5b0b-948d-47a6-b46a-029d53cd09a5 req-40869929-9964-4cd0-9ec6-59b4dc1a3e1d service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:33.538586 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [req-84ca5b0b-948d-47a6-b46a-029d53cd09a5 req-40869929-9964-4cd0-9ec6-59b4dc1a3e1d service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:33.554239 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.compute.server_external_events [req-84ca5b0b-948d-47a6-b46a-029d53cd09a5 req-40869929-9964-4cd0-9ec6-59b4dc1a3e1d service nova] Creating event network-changed:649f5ff3-9ef1-4a08-9cee-a5b3ce52f527 for instance 6f97e59a-6d5c-465e-91a7-479df09355e9 on hv-cinder-85014 Jul 18 08:57:33.560025 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [req-84ca5b0b-948d-47a6-b46a-029d53cd09a5 req-40869929-9964-4cd0-9ec6-59b4dc1a3e1d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039138 Jul 18 08:57:33.561171 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 545/1091] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:57:33.564075 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-1cf91235-4362-48af-bd59-27e1b73085e8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Going to try to terminate instance {{(pid=124894) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:57:33.912052 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-1cf91235-4362-48af-bd59-27e1b73085e8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 204 len: 0 microversion: 2.1 time: 0.394493 Jul 18 08:57:33.912889 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 547/1092] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:57:33 2022] DELETE /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:57:33.923247 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-cf82cb66-84e7-4598-b581-7eca80b98e44 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:33.926332 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-cf82cb66-84e7-4598-b581-7eca80b98e44 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:33.931861 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf82cb66-84e7-4598-b581-7eca80b98e44 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:33.932320 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf82cb66-84e7-4598-b581-7eca80b98e44 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:33.933106 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf82cb66-84e7-4598-b581-7eca80b98e44 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:33.933548 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-cf82cb66-84e7-4598-b581-7eca80b98e44 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:34.068489 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-cf82cb66-84e7-4598-b581-7eca80b98e44 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:57:34.076692 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-cf82cb66-84e7-4598-b581-7eca80b98e44 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1577 microversion: 2.1 time: 0.158233 Jul 18 08:57:34.077270 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 546/1093] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:33 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:57:35.097177 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-918d4760-752a-4f23-813c-537eed908db6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:35.097797 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-918d4760-752a-4f23-813c-537eed908db6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:35.104732 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-918d4760-752a-4f23-813c-537eed908db6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:35.105180 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-918d4760-752a-4f23-813c-537eed908db6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:35.105972 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-918d4760-752a-4f23-813c-537eed908db6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:35.106403 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-918d4760-752a-4f23-813c-537eed908db6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:35.245730 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-918d4760-752a-4f23-813c-537eed908db6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:57:35.253640 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-918d4760-752a-4f23-813c-537eed908db6 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1577 microversion: 2.1 time: 0.161345 Jul 18 08:57:35.254211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 548/1094] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:35 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:57:36.271021 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-8a8a2879-2655-456d-b3eb-cfc9297ac375 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:36.271602 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-8a8a2879-2655-456d-b3eb-cfc9297ac375 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:36.278497 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8a8a2879-2655-456d-b3eb-cfc9297ac375 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:36.278956 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8a8a2879-2655-456d-b3eb-cfc9297ac375 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:36.281282 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8a8a2879-2655-456d-b3eb-cfc9297ac375 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:36.281282 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-8a8a2879-2655-456d-b3eb-cfc9297ac375 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:36.511455 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-8a8a2879-2655-456d-b3eb-cfc9297ac375 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:57:36.520323 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-8a8a2879-2655-456d-b3eb-cfc9297ac375 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1577 microversion: 2.1 time: 0.253722 Jul 18 08:57:36.520994 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 547/1095] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:36 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:57:37.070330 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-c60ea231-f0e5-4007-907c-acf7b921ada3 req-b57e8567-19d6-47b9-b549-4ab14edcc786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f97e59a-6d5c-465e-91a7-479df09355e9", "name": "network-vif-deleted", "tag": "649f5ff3-9ef1-4a08-9cee-a5b3ce52f527"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:57:37.078791 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-c60ea231-f0e5-4007-907c-acf7b921ada3 req-b57e8567-19d6-47b9-b549-4ab14edcc786 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:37.079235 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-c60ea231-f0e5-4007-907c-acf7b921ada3 req-b57e8567-19d6-47b9-b549-4ab14edcc786 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:37.090974 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-c60ea231-f0e5-4007-907c-acf7b921ada3 req-b57e8567-19d6-47b9-b549-4ab14edcc786 service nova] Creating event network-vif-deleted:649f5ff3-9ef1-4a08-9cee-a5b3ce52f527 for instance 6f97e59a-6d5c-465e-91a7-479df09355e9 on hv-cinder-85014 Jul 18 08:57:37.095840 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-c60ea231-f0e5-4007-907c-acf7b921ada3 req-b57e8567-19d6-47b9-b549-4ab14edcc786 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085171 Jul 18 08:57:37.097447 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 549/1096] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:57:37.540497 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a5ba892e-cb5b-463f-ade7-3275b5c4dbd0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:37.542655 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a5ba892e-cb5b-463f-ade7-3275b5c4dbd0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:37.552684 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a5ba892e-cb5b-463f-ade7-3275b5c4dbd0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:37.553810 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a5ba892e-cb5b-463f-ade7-3275b5c4dbd0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:37.555083 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a5ba892e-cb5b-463f-ade7-3275b5c4dbd0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:37.556021 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a5ba892e-cb5b-463f-ade7-3275b5c4dbd0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:37.632338 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a5ba892e-cb5b-463f-ade7-3275b5c4dbd0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:57:37.640202 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a5ba892e-cb5b-463f-ade7-3275b5c4dbd0 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 200 len: 1225 microversion: 2.1 time: 0.105536 Jul 18 08:57:37.640773 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 548/1097] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:37 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:57:38.658483 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7fbc158a-5b71-484c-bc34-c948bb4948f8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:38.659171 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7fbc158a-5b71-484c-bc34-c948bb4948f8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6f97e59a-6d5c-465e-91a7-479df09355e9] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:38.666181 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7fbc158a-5b71-484c-bc34-c948bb4948f8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:38.666640 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7fbc158a-5b71-484c-bc34-c948bb4948f8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:38.667424 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7fbc158a-5b71-484c-bc34-c948bb4948f8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:38.667996 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7fbc158a-5b71-484c-bc34-c948bb4948f8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:38.681789 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-7fbc158a-5b71-484c-bc34-c948bb4948f8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] HTTP exception thrown: Instance 6f97e59a-6d5c-465e-91a7-479df09355e9 could not be found. Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7fbc158a-5b71-484c-bc34-c948bb4948f8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Request method failure captured: Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 HTTP/1.1 Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R6fvTPu-KbdM-KWRcpTJQJRS37AynBc6z4z_LRNVzqzJnVlvtn5ouM4UbnEMj1K03x0u78iYramkAeGMYyGOkXGstnlLCA4n0UUPD4_u5F8hQF786OYgyTFQH3yYB9gNSMUNq7n-S0-apWrGwOOYoGLcpTC2IzGtFpmPJO-gr9b9oI Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: d37f9217ffb94786830f0f6c5970b762 Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:57:38.685051 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d37f9217ffb94786830f0f6c5970b762", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: d37f9217ffb94786830f0f6c5970b762 Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-TestVolumeBootPattern-1293900826-project Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: ba4946e9565f4a608dd04fbc4de18dad Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-TestVolumeBootPattern-1293900826-project Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 6f97e59a-6d5c-465e-91a7-479df09355e9 could not be found. Jul 18 08:57:38.686738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '6f97e59a-6d5c-465e-91a7-479df09355e9'} Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f97e59a-6d5c-465e-91a7-479df09355e9 could not be found. Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:57:38.687751 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f97e59a-6d5c-465e-91a7-479df09355e9 could not be found. Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f97e59a-6d5c-465e-91a7-479df09355e9 could not be found. Jul 18 08:57:38.689599 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:38.691036 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7fbc158a-5b71-484c-bc34-c948bb4948f8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Returning 404 to user: Instance 6f97e59a-6d5c-465e-91a7-479df09355e9 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:57:38.691036 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7fbc158a-5b71-484c-bc34-c948bb4948f8 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9" status: 404 len: 111 microversion: 2.1 time: 0.031291 Jul 18 08:57:38.691036 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 550/1098] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:38 2022] GET /compute/v2.1/servers/6f97e59a-6d5c-465e-91a7-479df09355e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 08:57:42.095327 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-acd1ef87-c74d-4dd3-8064-4f7d7b7125d1 req-b185801b-a22a-4e9d-92ca-6172aa7d948c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6564cb4f-41b7-4106-ae7b-23423e789831", "tag": "3b545f2f-12bf-41b0-98e3-4c8943c85ca9"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:57:42.096984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-c1fdbcc5-5155-41d8-a5fe-5d291f3eafae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:42.102506 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c1fdbcc5-5155-41d8-a5fe-5d291f3eafae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:42.110476 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1fdbcc5-5155-41d8-a5fe-5d291f3eafae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:42.110476 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1fdbcc5-5155-41d8-a5fe-5d291f3eafae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:42.110733 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-acd1ef87-c74d-4dd3-8064-4f7d7b7125d1 req-b185801b-a22a-4e9d-92ca-6172aa7d948c service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:42.110846 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1fdbcc5-5155-41d8-a5fe-5d291f3eafae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:42.111043 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-acd1ef87-c74d-4dd3-8064-4f7d7b7125d1 req-b185801b-a22a-4e9d-92ca-6172aa7d948c service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:42.111211 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-c1fdbcc5-5155-41d8-a5fe-5d291f3eafae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:42.124426 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-acd1ef87-c74d-4dd3-8064-4f7d7b7125d1 req-b185801b-a22a-4e9d-92ca-6172aa7d948c service nova] Creating event network-changed:3b545f2f-12bf-41b0-98e3-4c8943c85ca9 for instance 6564cb4f-41b7-4106-ae7b-23423e789831 on hv-cinder-85014 Jul 18 08:57:42.129912 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-acd1ef87-c74d-4dd3-8064-4f7d7b7125d1 req-b185801b-a22a-4e9d-92ca-6172aa7d948c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037980 Jul 18 08:57:42.130635 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 551/1099] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:57:42.157054 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-c1fdbcc5-5155-41d8-a5fe-5d291f3eafae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Going to try to terminate instance {{(pid=124895) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 08:57:42.526936 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-c1fdbcc5-5155-41d8-a5fe-5d291f3eafae tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 204 len: 0 microversion: 2.1 time: 0.439689 Jul 18 08:57:42.531017 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 549/1100] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:57:42 2022] DELETE /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 08:57:42.539183 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-0cf20a6f-0366-455f-8af9-51da0b5f8c10 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:42.540310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-0cf20a6f-0366-455f-8af9-51da0b5f8c10 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:42.547780 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0cf20a6f-0366-455f-8af9-51da0b5f8c10 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:42.548234 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0cf20a6f-0366-455f-8af9-51da0b5f8c10 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:42.549584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0cf20a6f-0366-455f-8af9-51da0b5f8c10 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:42.550024 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-0cf20a6f-0366-455f-8af9-51da0b5f8c10 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:42.690637 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-0cf20a6f-0366-455f-8af9-51da0b5f8c10 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:57:42.700147 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-0cf20a6f-0366-455f-8af9-51da0b5f8c10 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1575 microversion: 2.1 time: 0.167401 Jul 18 08:57:42.700807 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 552/1101] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:42 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:57:43.719421 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-3948fd7c-1f24-47be-b866-be9310d52d23 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:43.720144 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-3948fd7c-1f24-47be-b866-be9310d52d23 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:43.726864 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3948fd7c-1f24-47be-b866-be9310d52d23 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:43.727346 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3948fd7c-1f24-47be-b866-be9310d52d23 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:43.728191 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3948fd7c-1f24-47be-b866-be9310d52d23 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:43.728638 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-3948fd7c-1f24-47be-b866-be9310d52d23 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:43.865797 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-3948fd7c-1f24-47be-b866-be9310d52d23 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:57:43.874122 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-3948fd7c-1f24-47be-b866-be9310d52d23 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1575 microversion: 2.1 time: 0.159013 Jul 18 08:57:43.874690 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 550/1102] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:43 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:57:44.586449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-488deeb5-24ce-4dfc-aff5-8f8218491006 req-3db2b438-3b79-4c65-8253-15b3c7816c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6564cb4f-41b7-4106-ae7b-23423e789831", "name": "network-vif-deleted", "tag": "3b545f2f-12bf-41b0-98e3-4c8943c85ca9"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:57:44.602449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-488deeb5-24ce-4dfc-aff5-8f8218491006 req-3db2b438-3b79-4c65-8253-15b3c7816c32 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:44.602449 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-488deeb5-24ce-4dfc-aff5-8f8218491006 req-3db2b438-3b79-4c65-8253-15b3c7816c32 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:44.622925 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-488deeb5-24ce-4dfc-aff5-8f8218491006 req-3db2b438-3b79-4c65-8253-15b3c7816c32 service nova] Creating event network-vif-deleted:3b545f2f-12bf-41b0-98e3-4c8943c85ca9 for instance 6564cb4f-41b7-4106-ae7b-23423e789831 on hv-cinder-85014 Jul 18 08:57:44.628999 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-488deeb5-24ce-4dfc-aff5-8f8218491006 req-3db2b438-3b79-4c65-8253-15b3c7816c32 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045971 Jul 18 08:57:44.629188 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 553/1103] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 08:57:44.893833 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-10519c0c-915d-4a15-baed-88539e7d72ef tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:44.894588 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-10519c0c-915d-4a15-baed-88539e7d72ef tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:44.902839 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10519c0c-915d-4a15-baed-88539e7d72ef tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:44.903479 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10519c0c-915d-4a15-baed-88539e7d72ef tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:44.904568 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10519c0c-915d-4a15-baed-88539e7d72ef tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:44.905103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-10519c0c-915d-4a15-baed-88539e7d72ef tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:44.982355 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-10519c0c-915d-4a15-baed-88539e7d72ef tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba4946e9565f4a608dd04fbc4de18dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37f9217ffb94786830f0f6c5970b762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:57:44.990509 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-10519c0c-915d-4a15-baed-88539e7d72ef tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 200 len: 1224 microversion: 2.1 time: 0.101374 Jul 18 08:57:44.991103 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 551/1104] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:44 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:57:46.007833 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9c4a82fc-1722-4e6a-835e-bc7b48c02976 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:46.008848 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-9c4a82fc-1722-4e6a-835e-bc7b48c02976 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: 6564cb4f-41b7-4106-ae7b-23423e789831] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:46.016164 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9c4a82fc-1722-4e6a-835e-bc7b48c02976 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:46.016628 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9c4a82fc-1722-4e6a-835e-bc7b48c02976 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:46.017403 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9c4a82fc-1722-4e6a-835e-bc7b48c02976 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:46.017840 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-9c4a82fc-1722-4e6a-835e-bc7b48c02976 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:46.032576 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-9c4a82fc-1722-4e6a-835e-bc7b48c02976 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] HTTP exception thrown: Instance 6564cb4f-41b7-4106-ae7b-23423e789831 could not be found. Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9c4a82fc-1722-4e6a-835e-bc7b48c02976 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Request method failure captured: Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 HTTP/1.1 Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R6fvTPu-KbdM-KWRcpTJQJRS37AynBc6z4z_LRNVzqzJnVlvtn5ouM4UbnEMj1K03x0u78iYramkAeGMYyGOkXGstnlLCA4n0UUPD4_u5F8hQF786OYgyTFQH3yYB9gNSMUNq7n-S0-apWrGwOOYoGLcpTC2IzGtFpmPJO-gr9b9oI Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: d37f9217ffb94786830f0f6c5970b762 Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:57:46.034238 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d37f9217ffb94786830f0f6c5970b762", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: d37f9217ffb94786830f0f6c5970b762 Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-TestVolumeBootPattern-1293900826-project Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: ba4946e9565f4a608dd04fbc4de18dad Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-TestVolumeBootPattern-1293900826-project Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 6564cb4f-41b7-4106-ae7b-23423e789831 could not be found. Jul 18 08:57:46.035971 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '6564cb4f-41b7-4106-ae7b-23423e789831'} Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6564cb4f-41b7-4106-ae7b-23423e789831 could not be found. Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:57:46.036794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6564cb4f-41b7-4106-ae7b-23423e789831 could not be found. Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6564cb4f-41b7-4106-ae7b-23423e789831 could not be found. Jul 18 08:57:46.038089 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.039227 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-9c4a82fc-1722-4e6a-835e-bc7b48c02976 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Returning 404 to user: Instance 6564cb4f-41b7-4106-ae7b-23423e789831 could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:57:46.039227 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-9c4a82fc-1722-4e6a-835e-bc7b48c02976 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831" status: 404 len: 111 microversion: 2.1 time: 0.032260 Jul 18 08:57:46.039227 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 554/1105] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:46 2022] GET /compute/v2.1/servers/6564cb4f-41b7-4106-ae7b-23423e789831 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:57:46.839854 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-50c5238f-099e-476c-a5ad-1324d2a137f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:46.844918 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-50c5238f-099e-476c-a5ad-1324d2a137f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:46.847099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50c5238f-099e-476c-a5ad-1324d2a137f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:46.847549 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50c5238f-099e-476c-a5ad-1324d2a137f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:46.848348 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50c5238f-099e-476c-a5ad-1324d2a137f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:46.848785 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-50c5238f-099e-476c-a5ad-1324d2a137f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:46.865238 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.wsgi [None req-50c5238f-099e-476c-a5ad-1324d2a137f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] HTTP exception thrown: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-50c5238f-099e-476c-a5ad-1324d2a137f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Request method failure captured: Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: request: DELETE /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe HTTP/1.1 Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept: application/json Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Accept-Encoding: identity Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Connection: close Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Length: 0 Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Content-Type: application/json Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Host: 10.222.0.57 Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Openstack-System-Scope: None Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: User-Agent: python-urllib3/1.26.9 Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Auth-Token: gAAAAABi1R6fvTPu-KbdM-KWRcpTJQJRS37AynBc6z4z_LRNVzqzJnVlvtn5ouM4UbnEMj1K03x0u78iYramkAeGMYyGOkXGstnlLCA4n0UUPD4_u5F8hQF786OYgyTFQH3yYB9gNSMUNq7n-S0-apWrGwOOYoGLcpTC2IzGtFpmPJO-gr9b9oI Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Id: None Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Domain-Name: None Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Identity-Status: Confirmed Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Is-Admin-Project: True Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Id: default Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Domain-Name: Default Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Id: d37f9217ffb94786830f0f6c5970b762 Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Project-Name: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Role: reader,member Jul 18 08:57:46.866946 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Roles: reader,member Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d37f9217ffb94786830f0f6c5970b762", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Id: d37f9217ffb94786830f0f6c5970b762 Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-Tenant-Name: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User: tempest-TestVolumeBootPattern-1293900826-project Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Id: default Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Domain-Name: Default Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Id: ba4946e9565f4a608dd04fbc4de18dad Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: X-User-Name: tempest-TestVolumeBootPattern-1293900826-project Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: method: > Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: exception: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:57:46.869678 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: action_args: {'id': 'c53c5dca-7e2b-4a47-9a81-7888b20e67fe'} Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:57:46.870603 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:57:46.872180 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.874049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-50c5238f-099e-476c-a5ad-1324d2a137f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Returning 404 to user: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. {{(pid=124895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:57:46.874049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-50c5238f-099e-476c-a5ad-1324d2a137f1 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 404 len: 111 microversion: 2.1 time: 0.033074 Jul 18 08:57:46.874049 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 552/1106] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 08:57:46 2022] DELETE /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:57:46.877747 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-591205f1-4abd-40c1-807b-ffed7e7ffcd7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:46.878389 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-591205f1-4abd-40c1-807b-ffed7e7ffcd7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] [instance: c53c5dca-7e2b-4a47-9a81-7888b20e67fe] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:57:46.885077 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-591205f1-4abd-40c1-807b-ffed7e7ffcd7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:46.885533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-591205f1-4abd-40c1-807b-ffed7e7ffcd7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:46.886297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-591205f1-4abd-40c1-807b-ffed7e7ffcd7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:57:46.886737 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-591205f1-4abd-40c1-807b-ffed7e7ffcd7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:57:46.900744 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-591205f1-4abd-40c1-807b-ffed7e7ffcd7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] HTTP exception thrown: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-591205f1-4abd-40c1-807b-ffed7e7ffcd7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Request method failure captured: Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe HTTP/1.1 Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R6fvTPu-KbdM-KWRcpTJQJRS37AynBc6z4z_LRNVzqzJnVlvtn5ouM4UbnEMj1K03x0u78iYramkAeGMYyGOkXGstnlLCA4n0UUPD4_u5F8hQF786OYgyTFQH3yYB9gNSMUNq7n-S0-apWrGwOOYoGLcpTC2IzGtFpmPJO-gr9b9oI Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: d37f9217ffb94786830f0f6c5970b762 Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 08:57:46.902293 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d37f9217ffb94786830f0f6c5970b762"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d37f9217ffb94786830f0f6c5970b762", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: d37f9217ffb94786830f0f6c5970b762 Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-TestVolumeBootPattern-1293900826 Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-TestVolumeBootPattern-1293900826-project Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: ba4946e9565f4a608dd04fbc4de18dad Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-TestVolumeBootPattern-1293900826-project Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:57:46.904279 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': 'c53c5dca-7e2b-4a47-9a81-7888b20e67fe'} Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 08:57:46.905289 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. Jul 18 08:57:46.906782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 08:57:46.908240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-591205f1-4abd-40c1-807b-ffed7e7ffcd7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Returning 404 to user: Instance c53c5dca-7e2b-4a47-9a81-7888b20e67fe could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 08:57:46.908240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-591205f1-4abd-40c1-807b-ffed7e7ffcd7 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe" status: 404 len: 111 microversion: 2.1 time: 0.029840 Jul 18 08:57:46.908240 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 555/1107] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:57:46 2022] GET /compute/v2.1/servers/c53c5dca-7e2b-4a47-9a81-7888b20e67fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 08:57:48.413066 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-88c8d639-bef0-4c1c-a263-a6daf8374f40 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] Calling method '.version_select at 0x7fafb727f550>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:57:48.529351 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-88c8d639-bef0-4c1c-a263-a6daf8374f40 tempest-TestVolumeBootPattern-1293900826 tempest-TestVolumeBootPattern-1293900826-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-239426097" status: 202 len: 0 microversion: 2.1 time: 0.120363 Jul 18 08:57:48.529910 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 553/1108] 10.222.0.57 () {58 vars in 1259 bytes} [Mon Jul 18 08:57:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-239426097 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:58:26.862185 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-54a1f3e6-13f2-47e1-bfbc-628e5eaac6eb tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:58:26.862763 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-54a1f3e6-13f2-47e1-bfbc-628e5eaac6eb tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:26.864851 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:58:26.865514 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:58:26.870397 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-54a1f3e6-13f2-47e1-bfbc-628e5eaac6eb tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:26.870852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-54a1f3e6-13f2-47e1-bfbc-628e5eaac6eb tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:26.871621 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-54a1f3e6-13f2-47e1-bfbc-628e5eaac6eb tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:26.872091 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-54a1f3e6-13f2-47e1-bfbc-628e5eaac6eb tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:26.894957 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.objects.instance [None req-54a1f3e6-13f2-47e1-bfbc-628e5eaac6eb tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lazy-loading 'flavor' on Instance uuid 22289fae-ddb5-467d-a1e2-0e56a49398cb {{(pid=124894) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 08:58:27.142418 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-54a1f3e6-13f2-47e1-bfbc-628e5eaac6eb tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "POST /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb/action" status: 202 len: 0 microversion: 2.1 time: 0.284445 Jul 18 08:58:27.142894 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 556/1109] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:58:26 2022] POST /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:58:27.148773 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:58:27.149510 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:58:27.153573 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-06e74a49-7d55-424e-a3c8-9e0d5df5b355 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:27.154184 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-06e74a49-7d55-424e-a3c8-9e0d5df5b355 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:27.161565 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-06e74a49-7d55-424e-a3c8-9e0d5df5b355 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:27.162023 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-06e74a49-7d55-424e-a3c8-9e0d5df5b355 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:27.162786 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-06e74a49-7d55-424e-a3c8-9e0d5df5b355 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:27.163215 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-06e74a49-7d55-424e-a3c8-9e0d5df5b355 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:27.297623 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-06e74a49-7d55-424e-a3c8-9e0d5df5b355 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:27.305298 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-06e74a49-7d55-424e-a3c8-9e0d5df5b355 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.158039 Jul 18 08:58:27.305861 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 554/1110] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:27 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:28.324247 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-89f9f448-ea85-4f5a-999d-d9580ad4c571 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:28.324946 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-89f9f448-ea85-4f5a-999d-d9580ad4c571 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:28.331923 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-89f9f448-ea85-4f5a-999d-d9580ad4c571 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:28.332375 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-89f9f448-ea85-4f5a-999d-d9580ad4c571 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:28.333142 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-89f9f448-ea85-4f5a-999d-d9580ad4c571 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:28.333574 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-89f9f448-ea85-4f5a-999d-d9580ad4c571 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:28.466259 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-89f9f448-ea85-4f5a-999d-d9580ad4c571 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:28.475026 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-89f9f448-ea85-4f5a-999d-d9580ad4c571 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.156240 Jul 18 08:58:28.475649 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 557/1111] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:28 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:29.492867 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-2ff03c05-a859-4767-8f9e-bdfe6508f8e5 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:29.493541 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-2ff03c05-a859-4767-8f9e-bdfe6508f8e5 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:29.502139 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2ff03c05-a859-4767-8f9e-bdfe6508f8e5 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:29.502585 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2ff03c05-a859-4767-8f9e-bdfe6508f8e5 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:29.503394 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2ff03c05-a859-4767-8f9e-bdfe6508f8e5 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:29.503867 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-2ff03c05-a859-4767-8f9e-bdfe6508f8e5 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:29.645605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-2ff03c05-a859-4767-8f9e-bdfe6508f8e5 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:29.653100 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-2ff03c05-a859-4767-8f9e-bdfe6508f8e5 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.164159 Jul 18 08:58:29.653661 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 555/1112] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:29 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:58:30.670287 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-299cd6a7-8b48-4919-b550-4a4a536a6311 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:30.670893 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-299cd6a7-8b48-4919-b550-4a4a536a6311 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:30.681855 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-299cd6a7-8b48-4919-b550-4a4a536a6311 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:30.682302 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-299cd6a7-8b48-4919-b550-4a4a536a6311 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:30.683069 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-299cd6a7-8b48-4919-b550-4a4a536a6311 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:30.683503 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-299cd6a7-8b48-4919-b550-4a4a536a6311 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:30.819605 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-299cd6a7-8b48-4919-b550-4a4a536a6311 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:30.827422 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-299cd6a7-8b48-4919-b550-4a4a536a6311 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.160990 Jul 18 08:58:30.828438 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 558/1113] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:30 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:31.845505 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-710fcc02-82d2-4187-9754-5e73f98852b2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:31.846116 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-710fcc02-82d2-4187-9754-5e73f98852b2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:31.852656 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-710fcc02-82d2-4187-9754-5e73f98852b2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:31.853099 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-710fcc02-82d2-4187-9754-5e73f98852b2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:31.853858 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-710fcc02-82d2-4187-9754-5e73f98852b2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:31.854289 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-710fcc02-82d2-4187-9754-5e73f98852b2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:31.983725 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-710fcc02-82d2-4187-9754-5e73f98852b2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:31.991901 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-710fcc02-82d2-4187-9754-5e73f98852b2 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.150773 Jul 18 08:58:31.992465 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 556/1114] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:31 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:33.009196 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-2866f749-78c0-48b5-b1f0-91296e7a2f63 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:33.009812 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-2866f749-78c0-48b5-b1f0-91296e7a2f63 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:33.016499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2866f749-78c0-48b5-b1f0-91296e7a2f63 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:33.016946 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2866f749-78c0-48b5-b1f0-91296e7a2f63 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:33.017719 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2866f749-78c0-48b5-b1f0-91296e7a2f63 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:33.018154 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-2866f749-78c0-48b5-b1f0-91296e7a2f63 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:33.150939 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-2866f749-78c0-48b5-b1f0-91296e7a2f63 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:33.159499 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-2866f749-78c0-48b5-b1f0-91296e7a2f63 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.154120 Jul 18 08:58:33.160105 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 559/1115] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:33 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:34.176866 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-150d37d2-4b0b-4a43-a002-cac307e33fd1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:34.177410 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-150d37d2-4b0b-4a43-a002-cac307e33fd1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:34.183948 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-150d37d2-4b0b-4a43-a002-cac307e33fd1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:34.184403 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-150d37d2-4b0b-4a43-a002-cac307e33fd1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:34.185172 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-150d37d2-4b0b-4a43-a002-cac307e33fd1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:34.185605 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-150d37d2-4b0b-4a43-a002-cac307e33fd1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:34.322434 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-150d37d2-4b0b-4a43-a002-cac307e33fd1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:34.330481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-150d37d2-4b0b-4a43-a002-cac307e33fd1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.157661 Jul 18 08:58:34.331058 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 557/1116] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:34 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:35.348666 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-fda01d71-30ad-499e-b6e5-1352b2dc54bf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:35.349268 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-fda01d71-30ad-499e-b6e5-1352b2dc54bf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:35.355482 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fda01d71-30ad-499e-b6e5-1352b2dc54bf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:35.355954 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fda01d71-30ad-499e-b6e5-1352b2dc54bf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:35.357191 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fda01d71-30ad-499e-b6e5-1352b2dc54bf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:35.357191 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-fda01d71-30ad-499e-b6e5-1352b2dc54bf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:35.488160 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-fda01d71-30ad-499e-b6e5-1352b2dc54bf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:35.495777 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-fda01d71-30ad-499e-b6e5-1352b2dc54bf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.151066 Jul 18 08:58:35.496341 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 560/1117] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:35 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:36.513941 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a82ddd3c-f8f9-406f-a5a1-ae5462ba8136 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:36.514553 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a82ddd3c-f8f9-406f-a5a1-ae5462ba8136 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:36.521870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a82ddd3c-f8f9-406f-a5a1-ae5462ba8136 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:36.522323 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a82ddd3c-f8f9-406f-a5a1-ae5462ba8136 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:36.523093 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a82ddd3c-f8f9-406f-a5a1-ae5462ba8136 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:36.523526 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a82ddd3c-f8f9-406f-a5a1-ae5462ba8136 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:36.655228 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a82ddd3c-f8f9-406f-a5a1-ae5462ba8136 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:36.663941 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a82ddd3c-f8f9-406f-a5a1-ae5462ba8136 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.154037 Jul 18 08:58:36.664512 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 558/1118] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:36 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:37.680476 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-22363c36-d9d4-4205-be8e-3db058384b0f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:37.681142 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-22363c36-d9d4-4205-be8e-3db058384b0f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:37.687626 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-22363c36-d9d4-4205-be8e-3db058384b0f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:37.688111 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-22363c36-d9d4-4205-be8e-3db058384b0f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:37.688883 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-22363c36-d9d4-4205-be8e-3db058384b0f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:37.689309 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-22363c36-d9d4-4205-be8e-3db058384b0f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:37.839969 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-22363c36-d9d4-4205-be8e-3db058384b0f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:37.852743 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-22363c36-d9d4-4205-be8e-3db058384b0f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.176187 Jul 18 08:58:37.853333 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 561/1119] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:37 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 08:58:38.873796 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-1e58221b-9f19-41fd-a17e-fc0dc83cc2a8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:38.874977 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-1e58221b-9f19-41fd-a17e-fc0dc83cc2a8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:38.881569 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1e58221b-9f19-41fd-a17e-fc0dc83cc2a8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:38.882011 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1e58221b-9f19-41fd-a17e-fc0dc83cc2a8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:38.882773 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1e58221b-9f19-41fd-a17e-fc0dc83cc2a8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:38.883207 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-1e58221b-9f19-41fd-a17e-fc0dc83cc2a8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:39.014986 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-1e58221b-9f19-41fd-a17e-fc0dc83cc2a8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:39.022984 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-1e58221b-9f19-41fd-a17e-fc0dc83cc2a8 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.153265 Jul 18 08:58:39.023557 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 559/1120] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:38 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:40.040258 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ce8e1773-f533-4934-8ee7-0837972c92cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:40.040986 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ce8e1773-f533-4934-8ee7-0837972c92cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:40.047381 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce8e1773-f533-4934-8ee7-0837972c92cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:40.047878 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce8e1773-f533-4934-8ee7-0837972c92cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:40.048703 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce8e1773-f533-4934-8ee7-0837972c92cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:40.049140 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ce8e1773-f533-4934-8ee7-0837972c92cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:40.183132 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ce8e1773-f533-4934-8ee7-0837972c92cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:40.191630 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ce8e1773-f533-4934-8ee7-0837972c92cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1569 microversion: 2.1 time: 0.155228 Jul 18 08:58:40.192232 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 562/1121] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:40 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:41.210009 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-19ebe90c-de43-47e9-84f8-e4dbaee91cc6 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:41.210614 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-19ebe90c-de43-47e9-84f8-e4dbaee91cc6 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:41.216847 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-19ebe90c-de43-47e9-84f8-e4dbaee91cc6 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:41.217337 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-19ebe90c-de43-47e9-84f8-e4dbaee91cc6 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:41.218117 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-19ebe90c-de43-47e9-84f8-e4dbaee91cc6 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:41.218541 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-19ebe90c-de43-47e9-84f8-e4dbaee91cc6 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:41.354243 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-19ebe90c-de43-47e9-84f8-e4dbaee91cc6 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:41.363242 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-19ebe90c-de43-47e9-84f8-e4dbaee91cc6 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1510 microversion: 2.1 time: 0.157219 Jul 18 08:58:41.363860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 560/1122] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:41 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:41.379348 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-bd554802-ca08-4981-a61c-b2c5ac265c43 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:58:41.379992 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-bd554802-ca08-4981-a61c-b2c5ac265c43 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:41.386547 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd554802-ca08-4981-a61c-b2c5ac265c43 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:41.386992 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd554802-ca08-4981-a61c-b2c5ac265c43 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:41.387782 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd554802-ca08-4981-a61c-b2c5ac265c43 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:41.388220 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-bd554802-ca08-4981-a61c-b2c5ac265c43 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:41.605561 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bd554802-ca08-4981-a61c-b2c5ac265c43 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [36e99133-84d9-487b-b66b-9529c86e7bca] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 08:58:42.614031 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO oslo.messaging._drivers.impl_rabbit [None req-bd554802-ca08-4981-a61c-b2c5ac265c43 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [36e99133-84d9-487b-b66b-9529c86e7bca] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 44604. Jul 18 08:58:42.618276 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-bd554802-ca08-4981-a61c-b2c5ac265c43 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "POST /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb/action" status: 202 len: 0 microversion: 2.1 time: 1.242724 Jul 18 08:58:42.618895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 563/1123] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Jul 18 08:58:41 2022] POST /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb/action => generated 0 bytes in 1244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 08:58:42.627101 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-a7c9975d-87fc-409d-8485-bbb70b8bfb5f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:42.627866 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-a7c9975d-87fc-409d-8485-bbb70b8bfb5f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:42.634504 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a7c9975d-87fc-409d-8485-bbb70b8bfb5f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:42.639808 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a7c9975d-87fc-409d-8485-bbb70b8bfb5f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:42.639808 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a7c9975d-87fc-409d-8485-bbb70b8bfb5f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:42.639808 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-a7c9975d-87fc-409d-8485-bbb70b8bfb5f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:42.769665 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-a7c9975d-87fc-409d-8485-bbb70b8bfb5f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:42.777840 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-a7c9975d-87fc-409d-8485-bbb70b8bfb5f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1518 microversion: 2.1 time: 0.154587 Jul 18 08:58:42.778411 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 561/1124] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:42 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:43.100329 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-37498f48-bd8c-46b1-8d24-d4d473e163d5 req-178bf308-3298-48fc-98a6-2be18fb29e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22289fae-ddb5-467d-a1e2-0e56a49398cb", "name": "network-vif-unplugged", "status": "completed", "tag": "7e90d63d-9e1b-4274-b07d-aa12cb6b3c70"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:58:43.108664 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-37498f48-bd8c-46b1-8d24-d4d473e163d5 req-178bf308-3298-48fc-98a6-2be18fb29e61 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:43.109211 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-37498f48-bd8c-46b1-8d24-d4d473e163d5 req-178bf308-3298-48fc-98a6-2be18fb29e61 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:43.120688 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.compute.server_external_events [req-37498f48-bd8c-46b1-8d24-d4d473e163d5 req-178bf308-3298-48fc-98a6-2be18fb29e61 service nova] Unable to find a host for instance 22289fae-ddb5-467d-a1e2-0e56a49398cb. Dropping event network-vif-unplugged {{(pid=124894) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 08:58:43.121604 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-37498f48-bd8c-46b1-8d24-d4d473e163d5 req-178bf308-3298-48fc-98a6-2be18fb29e61 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.144730 Jul 18 08:58:43.122194 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 564/1125] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 146 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 08:58:43.795303 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-910f1a63-e97b-4da6-9ea9-53db9b2e4a5d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:43.795961 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-910f1a63-e97b-4da6-9ea9-53db9b2e4a5d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:43.803285 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-910f1a63-e97b-4da6-9ea9-53db9b2e4a5d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:43.803773 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-910f1a63-e97b-4da6-9ea9-53db9b2e4a5d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:43.804580 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-910f1a63-e97b-4da6-9ea9-53db9b2e4a5d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:43.805016 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-910f1a63-e97b-4da6-9ea9-53db9b2e4a5d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:43.938525 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-910f1a63-e97b-4da6-9ea9-53db9b2e4a5d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:43.946507 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-910f1a63-e97b-4da6-9ea9-53db9b2e4a5d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1518 microversion: 2.1 time: 0.155143 Jul 18 08:58:43.947079 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 562/1126] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:43 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:44.964170 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-328cdd6c-6979-47f6-af7b-0d5f5684298a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:44.964785 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-328cdd6c-6979-47f6-af7b-0d5f5684298a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:44.971229 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-328cdd6c-6979-47f6-af7b-0d5f5684298a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:44.971700 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-328cdd6c-6979-47f6-af7b-0d5f5684298a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:44.972461 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-328cdd6c-6979-47f6-af7b-0d5f5684298a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:44.973965 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-328cdd6c-6979-47f6-af7b-0d5f5684298a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:45.102912 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-328cdd6c-6979-47f6-af7b-0d5f5684298a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:45.110827 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-328cdd6c-6979-47f6-af7b-0d5f5684298a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1518 microversion: 2.1 time: 0.150499 Jul 18 08:58:45.111391 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 565/1127] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:44 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:46.128096 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d2715dc0-9d9f-42ec-8cac-477eb4905f1f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:46.128663 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d2715dc0-9d9f-42ec-8cac-477eb4905f1f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:46.136121 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2715dc0-9d9f-42ec-8cac-477eb4905f1f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:46.138200 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2715dc0-9d9f-42ec-8cac-477eb4905f1f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:46.138200 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2715dc0-9d9f-42ec-8cac-477eb4905f1f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:46.138200 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d2715dc0-9d9f-42ec-8cac-477eb4905f1f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:46.273298 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d2715dc0-9d9f-42ec-8cac-477eb4905f1f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:46.282682 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d2715dc0-9d9f-42ec-8cac-477eb4905f1f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1518 microversion: 2.1 time: 0.157050 Jul 18 08:58:46.282682 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 563/1128] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:46 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:47.300410 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7081e8e2-395b-4db9-b38b-e12a93a665a1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:47.301041 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7081e8e2-395b-4db9-b38b-e12a93a665a1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:47.307862 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7081e8e2-395b-4db9-b38b-e12a93a665a1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:47.308310 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7081e8e2-395b-4db9-b38b-e12a93a665a1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:47.309068 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7081e8e2-395b-4db9-b38b-e12a93a665a1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:47.309502 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7081e8e2-395b-4db9-b38b-e12a93a665a1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:47.441151 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7081e8e2-395b-4db9-b38b-e12a93a665a1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:47.449142 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7081e8e2-395b-4db9-b38b-e12a93a665a1 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1518 microversion: 2.1 time: 0.152609 Jul 18 08:58:47.449716 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 566/1129] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:47 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:48.466655 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-87f3f717-d831-4096-93e3-d9e12795c5b0 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:48.467513 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-87f3f717-d831-4096-93e3-d9e12795c5b0 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:48.475521 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-87f3f717-d831-4096-93e3-d9e12795c5b0 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:48.476010 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-87f3f717-d831-4096-93e3-d9e12795c5b0 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:48.476782 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-87f3f717-d831-4096-93e3-d9e12795c5b0 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:48.477216 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-87f3f717-d831-4096-93e3-d9e12795c5b0 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:48.611173 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-87f3f717-d831-4096-93e3-d9e12795c5b0 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:48.619400 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-87f3f717-d831-4096-93e3-d9e12795c5b0 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1520 microversion: 2.1 time: 0.156911 Jul 18 08:58:48.620079 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 564/1130] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:48 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:49.637936 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-cc21fb00-fde4-4a43-9967-7ec935e1c214 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:49.638561 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-cc21fb00-fde4-4a43-9967-7ec935e1c214 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:49.645379 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cc21fb00-fde4-4a43-9967-7ec935e1c214 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:49.646447 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cc21fb00-fde4-4a43-9967-7ec935e1c214 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:49.647243 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cc21fb00-fde4-4a43-9967-7ec935e1c214 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:49.647694 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-cc21fb00-fde4-4a43-9967-7ec935e1c214 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:49.734981 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 08:58:49.735468 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Mon Jul 18 08:58:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb (ip 10.222.0.57) !!! Jul 18 08:58:49.797498 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-cc21fb00-fde4-4a43-9967-7ec935e1c214 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:49.807054 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-cc21fb00-fde4-4a43-9967-7ec935e1c214 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1576 microversion: 2.1 time: 0.173051 Jul 18 08:58:49.807641 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 567/1131] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:49 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:50.824777 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-750cb999-e804-42b5-8cba-8d6cd9a11e22 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:50.825396 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-750cb999-e804-42b5-8cba-8d6cd9a11e22 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:50.832007 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-750cb999-e804-42b5-8cba-8d6cd9a11e22 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:50.832461 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-750cb999-e804-42b5-8cba-8d6cd9a11e22 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:50.833381 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-750cb999-e804-42b5-8cba-8d6cd9a11e22 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:50.833836 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-750cb999-e804-42b5-8cba-8d6cd9a11e22 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:50.963916 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-750cb999-e804-42b5-8cba-8d6cd9a11e22 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:50.971487 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-750cb999-e804-42b5-8cba-8d6cd9a11e22 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1576 microversion: 2.1 time: 0.150598 Jul 18 08:58:50.972082 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 565/1132] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:50 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:51.990173 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-5ff3cb2a-8730-46dc-8042-728484a7641d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:51.990927 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-5ff3cb2a-8730-46dc-8042-728484a7641d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:51.997613 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ff3cb2a-8730-46dc-8042-728484a7641d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:51.999895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ff3cb2a-8730-46dc-8042-728484a7641d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:51.999895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ff3cb2a-8730-46dc-8042-728484a7641d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:51.999895 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-5ff3cb2a-8730-46dc-8042-728484a7641d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:52.136054 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-5ff3cb2a-8730-46dc-8042-728484a7641d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:52.143963 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-5ff3cb2a-8730-46dc-8042-728484a7641d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1576 microversion: 2.1 time: 0.158259 Jul 18 08:58:52.144555 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 568/1133] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:51 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:53.162795 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e801a5bb-735a-44be-8c6f-c587a8ce6c7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:53.163409 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e801a5bb-735a-44be-8c6f-c587a8ce6c7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:53.170191 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e801a5bb-735a-44be-8c6f-c587a8ce6c7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:53.170640 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e801a5bb-735a-44be-8c6f-c587a8ce6c7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:53.171399 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e801a5bb-735a-44be-8c6f-c587a8ce6c7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:53.171870 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e801a5bb-735a-44be-8c6f-c587a8ce6c7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:53.307691 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e801a5bb-735a-44be-8c6f-c587a8ce6c7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:53.315569 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e801a5bb-735a-44be-8c6f-c587a8ce6c7a tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1576 microversion: 2.1 time: 0.157108 Jul 18 08:58:53.316133 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 566/1134] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:53 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:54.332828 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-7a79726b-3da6-4359-b206-57485973d445 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:54.333594 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-7a79726b-3da6-4359-b206-57485973d445 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:54.339937 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a79726b-3da6-4359-b206-57485973d445 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:54.340384 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a79726b-3da6-4359-b206-57485973d445 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:54.341137 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a79726b-3da6-4359-b206-57485973d445 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:54.341567 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-7a79726b-3da6-4359-b206-57485973d445 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:54.478682 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-7a79726b-3da6-4359-b206-57485973d445 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:54.486160 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-7a79726b-3da6-4359-b206-57485973d445 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1576 microversion: 2.1 time: 0.157225 Jul 18 08:58:54.486727 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 569/1135] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:54 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:55.503860 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-54384515-ef40-4a43-ba0f-b445979c44cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:55.504483 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-54384515-ef40-4a43-ba0f-b445979c44cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:55.511713 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-54384515-ef40-4a43-ba0f-b445979c44cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:55.512184 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-54384515-ef40-4a43-ba0f-b445979c44cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:55.512954 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-54384515-ef40-4a43-ba0f-b445979c44cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:55.513399 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-54384515-ef40-4a43-ba0f-b445979c44cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:55.644234 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-54384515-ef40-4a43-ba0f-b445979c44cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:55.652169 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-54384515-ef40-4a43-ba0f-b445979c44cf tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1576 microversion: 2.1 time: 0.152230 Jul 18 08:58:55.652769 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 567/1136] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:55 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:56.668476 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-a99578c0-4db2-4804-8196-dfbba89226fe tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:56.669092 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-a99578c0-4db2-4804-8196-dfbba89226fe tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:56.675585 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a99578c0-4db2-4804-8196-dfbba89226fe tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:56.676185 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a99578c0-4db2-4804-8196-dfbba89226fe tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:56.676975 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a99578c0-4db2-4804-8196-dfbba89226fe tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:56.677410 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-a99578c0-4db2-4804-8196-dfbba89226fe tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:56.681493 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:58:56.809054 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-a99578c0-4db2-4804-8196-dfbba89226fe tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:56.816506 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-a99578c0-4db2-4804-8196-dfbba89226fe tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1576 microversion: 2.1 time: 0.151825 Jul 18 08:58:56.817062 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 570/1137] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:56 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:57.836105 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e9a0b4d9-1036-4c1d-8117-afd813c5aa78 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:57.836681 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e9a0b4d9-1036-4c1d-8117-afd813c5aa78 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:57.843233 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9a0b4d9-1036-4c1d-8117-afd813c5aa78 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:57.843697 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9a0b4d9-1036-4c1d-8117-afd813c5aa78 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:57.844473 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9a0b4d9-1036-4c1d-8117-afd813c5aa78 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:57.844903 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9a0b4d9-1036-4c1d-8117-afd813c5aa78 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:57.973340 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e9a0b4d9-1036-4c1d-8117-afd813c5aa78 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:57.980981 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e9a0b4d9-1036-4c1d-8117-afd813c5aa78 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1576 microversion: 2.1 time: 0.149109 Jul 18 08:58:57.981541 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 568/1138] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:57 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:58:58.998297 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-e3f466ef-2b0c-42b2-9afb-6027f664b71d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:58:58.998951 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-e3f466ef-2b0c-42b2-9afb-6027f664b71d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:58:59.001337 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=33 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:58:59.006847 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e3f466ef-2b0c-42b2-9afb-6027f664b71d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:59.007496 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e3f466ef-2b0c-42b2-9afb-6027f664b71d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:59.008315 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e3f466ef-2b0c-42b2-9afb-6027f664b71d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:58:59.008758 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-e3f466ef-2b0c-42b2-9afb-6027f664b71d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:58:59.145768 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-e3f466ef-2b0c-42b2-9afb-6027f664b71d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:58:59.154426 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-e3f466ef-2b0c-42b2-9afb-6027f664b71d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1576 microversion: 2.1 time: 0.160290 Jul 18 08:58:59.155549 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 571/1139] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:58:58 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:59:00.171732 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-4e5050dd-ee83-46a0-85c5-a685b85d10dc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:59:00.172325 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-4e5050dd-ee83-46a0-85c5-a685b85d10dc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:59:00.174667 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=31 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:59:00.179543 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4e5050dd-ee83-46a0-85c5-a685b85d10dc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:59:00.180032 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4e5050dd-ee83-46a0-85c5-a685b85d10dc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:59:00.180807 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4e5050dd-ee83-46a0-85c5-a685b85d10dc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:59:00.181246 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-4e5050dd-ee83-46a0-85c5-a685b85d10dc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:59:00.183855 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=91 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 08:59:00.581768 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-4e5050dd-ee83-46a0-85c5-a685b85d10dc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:59:00.590008 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-4e5050dd-ee83-46a0-85c5-a685b85d10dc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1576 microversion: 2.1 time: 0.422307 Jul 18 08:59:00.590572 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 569/1140] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:59:00 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1576 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:59:01.129223 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-bec64532-9f1a-40f5-bdfa-a0a042f67ab3 req-335bbf1f-349e-4a02-86ad-1b0647aaf7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22289fae-ddb5-467d-a1e2-0e56a49398cb", "name": "network-vif-plugged", "status": "completed", "tag": "7e90d63d-9e1b-4274-b07d-aa12cb6b3c70"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 08:59:01.138016 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-bec64532-9f1a-40f5-bdfa-a0a042f67ab3 req-335bbf1f-349e-4a02-86ad-1b0647aaf7c3 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:59:01.138468 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-bec64532-9f1a-40f5-bdfa-a0a042f67ab3 req-335bbf1f-349e-4a02-86ad-1b0647aaf7c3 service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:59:01.149577 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-bec64532-9f1a-40f5-bdfa-a0a042f67ab3 req-335bbf1f-349e-4a02-86ad-1b0647aaf7c3 service nova] Creating event network-vif-plugged:7e90d63d-9e1b-4274-b07d-aa12cb6b3c70 for instance 22289fae-ddb5-467d-a1e2-0e56a49398cb on hv-cinder-85014 Jul 18 08:59:01.154766 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-bec64532-9f1a-40f5-bdfa-a0a042f67ab3 req-335bbf1f-349e-4a02-86ad-1b0647aaf7c3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029262 Jul 18 08:59:01.155346 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 572/1141] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 08:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 08:59:01.607043 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e9fdfe78-b499-403e-bc80-59564baf5336 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:59:01.607656 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-e9fdfe78-b499-403e-bc80-59564baf5336 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:59:01.614202 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9fdfe78-b499-403e-bc80-59564baf5336 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:59:01.614642 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9fdfe78-b499-403e-bc80-59564baf5336 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:59:01.615481 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9fdfe78-b499-403e-bc80-59564baf5336 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:59:01.615941 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-e9fdfe78-b499-403e-bc80-59564baf5336 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:59:01.748417 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-e9fdfe78-b499-403e-bc80-59564baf5336 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:59:01.755900 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e9fdfe78-b499-403e-bc80-59564baf5336 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1576 microversion: 2.1 time: 0.152736 Jul 18 08:59:01.756660 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 570/1142] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:59:01 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 08:59:02.774412 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-ffc6590e-12ff-4b8a-9cf4-fc98533f23e9 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 08:59:02.775113 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-ffc6590e-12ff-4b8a-9cf4-fc98533f23e9 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 08:59:02.781533 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ffc6590e-12ff-4b8a-9cf4-fc98533f23e9 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:59:02.781982 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ffc6590e-12ff-4b8a-9cf4-fc98533f23e9 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:59:02.782744 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ffc6590e-12ff-4b8a-9cf4-fc98533f23e9 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 08:59:02.783179 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-ffc6590e-12ff-4b8a-9cf4-fc98533f23e9 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 08:59:02.919910 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-ffc6590e-12ff-4b8a-9cf4-fc98533f23e9 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 08:59:02.927384 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-ffc6590e-12ff-4b8a-9cf4-fc98533f23e9 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1563 microversion: 2.1 time: 0.158289 Jul 18 08:59:02.928819 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 573/1143] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 08:59:02 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 09:00:16.268626 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_api:SELECT=3 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:00:16.269380 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG dbcounter [-] [124895] Writing DB stats nova_cell1:SELECT=11 {{(pid=124895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:00:16.273427 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-ee37d4b2-0e3e-435d-a614-cb2cc6a4fedc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 09:00:16.275043 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ee37d4b2-0e3e-435d-a614-cb2cc6a4fedc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 09:00:16.275501 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-900dacc2-8e01-4ab7-ab41-087e64cd4ebd req-e1a9edf2-e9ba-4729-b726-6e55301b84ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22289fae-ddb5-467d-a1e2-0e56a49398cb", "tag": "7e90d63d-9e1b-4274-b07d-aa12cb6b3c70"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 09:00:16.280557 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ee37d4b2-0e3e-435d-a614-cb2cc6a4fedc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:16.281015 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ee37d4b2-0e3e-435d-a614-cb2cc6a4fedc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:16.282484 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ee37d4b2-0e3e-435d-a614-cb2cc6a4fedc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:16.282936 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-ee37d4b2-0e3e-435d-a614-cb2cc6a4fedc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:16.284610 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_api:SELECT=5 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:00:16.285650 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG dbcounter [-] [124894] Writing DB stats nova_cell1:SELECT=18 {{(pid=124894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 09:00:16.288117 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-900dacc2-8e01-4ab7-ab41-087e64cd4ebd req-e1a9edf2-e9ba-4729-b726-6e55301b84ce service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:16.288760 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-900dacc2-8e01-4ab7-ab41-087e64cd4ebd req-e1a9edf2-e9ba-4729-b726-6e55301b84ce service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:16.305508 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-900dacc2-8e01-4ab7-ab41-087e64cd4ebd req-e1a9edf2-e9ba-4729-b726-6e55301b84ce service nova] Creating event network-changed:7e90d63d-9e1b-4274-b07d-aa12cb6b3c70 for instance 22289fae-ddb5-467d-a1e2-0e56a49398cb on hv-cinder-85014 Jul 18 09:00:16.309459 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-ee37d4b2-0e3e-435d-a614-cb2cc6a4fedc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Going to try to terminate instance {{(pid=124895) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 09:00:16.311513 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-900dacc2-8e01-4ab7-ab41-087e64cd4ebd req-e1a9edf2-e9ba-4729-b726-6e55301b84ce service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042402 Jul 18 09:00:16.312720 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 574/1144] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 09:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 09:00:16.521614 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ee37d4b2-0e3e-435d-a614-cb2cc6a4fedc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [b7c4f023-bf5a-4e25-bd61-e8c91c12555b] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 09:00:17.529558 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO oslo.messaging._drivers.impl_rabbit [None req-ee37d4b2-0e3e-435d-a614-cb2cc6a4fedc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [b7c4f023-bf5a-4e25-bd61-e8c91c12555b] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 44686. Jul 18 09:00:17.609666 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-ee37d4b2-0e3e-435d-a614-cb2cc6a4fedc tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "DELETE /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 204 len: 0 microversion: 2.1 time: 1.343158 Jul 18 09:00:17.610260 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 571/1145] 10.222.0.57 () {58 vars in 1238 bytes} [Mon Jul 18 09:00:16 2022] DELETE /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 0 bytes in 1344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 09:00:17.621059 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-f53879e0-7e15-4619-99a8-f3eeb22afc0d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 09:00:17.622617 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-f53879e0-7e15-4619-99a8-f3eeb22afc0d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 09:00:17.628852 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f53879e0-7e15-4619-99a8-f3eeb22afc0d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:17.629343 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f53879e0-7e15-4619-99a8-f3eeb22afc0d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:17.630097 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f53879e0-7e15-4619-99a8-f3eeb22afc0d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:17.630527 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-f53879e0-7e15-4619-99a8-f3eeb22afc0d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:17.802963 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.policy [None req-f53879e0-7e15-4619-99a8-f3eeb22afc0d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124894) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 09:00:17.811584 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-f53879e0-7e15-4619-99a8-f3eeb22afc0d tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1450 microversion: 2.1 time: 0.196594 Jul 18 09:00:17.812190 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 575/1146] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 09:00:17 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1450 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 09:00:18.828980 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-934b6b6c-bc73-4c5e-9986-c1e18b8dc91b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 09:00:18.829685 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-934b6b6c-bc73-4c5e-9986-c1e18b8dc91b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 09:00:18.837287 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-934b6b6c-bc73-4c5e-9986-c1e18b8dc91b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:18.837738 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-934b6b6c-bc73-4c5e-9986-c1e18b8dc91b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:18.838610 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-934b6b6c-bc73-4c5e-9986-c1e18b8dc91b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:18.839148 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-934b6b6c-bc73-4c5e-9986-c1e18b8dc91b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:18.972903 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-934b6b6c-bc73-4c5e-9986-c1e18b8dc91b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 09:00:18.981174 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-934b6b6c-bc73-4c5e-9986-c1e18b8dc91b tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1450 microversion: 2.1 time: 0.156557 Jul 18 09:00:18.981740 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 572/1147] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 09:00:18 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 09:00:19.634062 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [req-9595a35c-85b5-4dfe-a422-77ebc77f17c1 req-2af871b0-b0c7-417b-ac2c-ec104fad6ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22289fae-ddb5-467d-a1e2-0e56a49398cb", "name": "network-vif-deleted", "tag": "7e90d63d-9e1b-4274-b07d-aa12cb6b3c70"}]} {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 09:00:19.643416 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-9595a35c-85b5-4dfe-a422-77ebc77f17c1 req-2af871b0-b0c7-417b-ac2c-ec104fad6ead service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:19.643897 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [req-9595a35c-85b5-4dfe-a422-77ebc77f17c1 req-2af871b0-b0c7-417b-ac2c-ec104fad6ead service nova] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:19.655405 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.compute.server_external_events [req-9595a35c-85b5-4dfe-a422-77ebc77f17c1 req-2af871b0-b0c7-417b-ac2c-ec104fad6ead service nova] Creating event network-vif-deleted:7e90d63d-9e1b-4274-b07d-aa12cb6b3c70 for instance 22289fae-ddb5-467d-a1e2-0e56a49398cb on hv-cinder-85014 Jul 18 09:00:19.664783 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [req-9595a35c-85b5-4dfe-a422-77ebc77f17c1 req-2af871b0-b0c7-417b-ac2c-ec104fad6ead service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030198 Jul 18 09:00:19.664783 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 576/1148] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Jul 18 09:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 09:00:19.999200 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-d5120316-9e0b-43bd-966b-b269600ffe13 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 09:00:19.999854 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.compute.api [None req-d5120316-9e0b-43bd-966b-b269600ffe13 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124895) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 09:00:20.006879 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d5120316-9e0b-43bd-966b-b269600ffe13 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:20.007332 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d5120316-9e0b-43bd-966b-b269600ffe13 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:20.008177 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d5120316-9e0b-43bd-966b-b269600ffe13 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:20.008619 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG oslo_concurrency.lockutils [None req-d5120316-9e0b-43bd-966b-b269600ffe13 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:20.079731 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.policy [None req-d5120316-9e0b-43bd-966b-b269600ffe13 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '124957514a4e4c35bed50a19de1dda6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f69056ca3e4e7c83f6c36c8e16c16c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124895) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 09:00:20.084957 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-d5120316-9e0b-43bd-966b-b269600ffe13 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 200 len: 1219 microversion: 2.1 time: 0.090384 Jul 18 09:00:20.085529 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 573/1149] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 09:00:19 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 09:00:21.103894 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-46fb7c46-5861-43f8-9f71-14e96abbda9f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '>' {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 09:00:21.104598 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.compute.api [None req-46fb7c46-5861-43f8-9f71-14e96abbda9f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] [instance: 22289fae-ddb5-467d-a1e2-0e56a49398cb] Fetching instance by UUID {{(pid=124894) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 09:00:21.112189 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-46fb7c46-5861-43f8-9f71-14e96abbda9f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:21.112738 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-46fb7c46-5861-43f8-9f71-14e96abbda9f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:21.113509 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-46fb7c46-5861-43f8-9f71-14e96abbda9f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 09:00:21.113950 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG oslo_concurrency.lockutils [None req-46fb7c46-5861-43f8-9f71-14e96abbda9f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Lock "a95f31f0-4a9c-41fb-bbc6-aecf1d775be2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 09:00:21.128379 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.wsgi [None req-46fb7c46-5861-43f8-9f71-14e96abbda9f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] HTTP exception thrown: Instance 22289fae-ddb5-467d-a1e2-0e56a49398cb could not be found. Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-46fb7c46-5861-43f8-9f71-14e96abbda9f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Request method failure captured: Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: request: GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb HTTP/1.1 Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept: application/json Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Accept-Encoding: identity Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Connection: close Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Length: 0 Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Content-Type: application/json Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Host: 10.222.0.57 Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Openstack-System-Scope: None Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: User-Agent: python-urllib3/1.26.9 Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Auth-Token: gAAAAABi1R_6a7pDqPLaNaH5Cr4OgZimSl4cICHcjo9Yh3LasAgmV6ysiJ51Kn-JyAWzeg5CUc6AJENr0Y-zu56492MZWJxABojG8ai8iT5_Qv8N52fd9SSQHNefbLXiFhzKTdDRjWAWy1P3mWhYKyEHUJZewaU0doiOcx50TRKAEcJ-p1FWZUY Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Id: None Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Domain-Name: None Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Identity-Status: Confirmed Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Is-Admin-Project: True Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Id: default Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Domain-Name: Default Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Id: 98f69056ca3e4e7c83f6c36c8e16c16c Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Project-Name: tempest-TestShelveInstance-1581464220 Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Role: reader,member Jul 18 09:00:21.130040 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Roles: reader,member Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/98f69056ca3e4e7c83f6c36c8e16c16c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/98f69056ca3e4e7c83f6c36c8e16c16c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/98f69056ca3e4e7c83f6c36c8e16c16c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_98f69056ca3e4e7c83f6c36c8e16c16c", "adminURL": "http://10.222.0.57:8080"}]}] Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant: tempest-TestShelveInstance-1581464220 Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Id: 98f69056ca3e4e7c83f6c36c8e16c16c Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-Tenant-Name: tempest-TestShelveInstance-1581464220 Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User: tempest-TestShelveInstance-1581464220-project Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Id: default Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Domain-Name: Default Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Id: 124957514a4e4c35bed50a19de1dda6d Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: X-User-Name: tempest-TestShelveInstance-1581464220-project Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: method: > Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: exception: Instance 22289fae-ddb5-467d-a1e2-0e56a49398cb could not be found. Jul 18 09:00:21.131832 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: action_args: {'id': '22289fae-ddb5-467d-a1e2-0e56a49398cb'} Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: {{(pid=124894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22289fae-ddb5-467d-a1e2-0e56a49398cb could not be found. Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 09:00:21.132835 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22289fae-ddb5-467d-a1e2-0e56a49398cb could not be found. Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22289fae-ddb5-467d-a1e2-0e56a49398cb could not be found. Jul 18 09:00:21.134411 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: ERROR nova.api.openstack.wsgi Jul 18 09:00:21.135755 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: DEBUG nova.api.openstack.wsgi [None req-46fb7c46-5861-43f8-9f71-14e96abbda9f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Returning 404 to user: Instance 22289fae-ddb5-467d-a1e2-0e56a49398cb could not be found. {{(pid=124894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 09:00:21.135755 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO nova.api.openstack.requestlog [None req-46fb7c46-5861-43f8-9f71-14e96abbda9f tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb" status: 404 len: 111 microversion: 2.1 time: 0.031928 Jul 18 09:00:21.135755 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: [pid: 124894|app: 0|req: 577/1150] 10.222.0.57 () {58 vars in 1235 bytes} [Mon Jul 18 09:00:21 2022] GET /compute/v2.1/servers/22289fae-ddb5-467d-a1e2-0e56a49398cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 09:00:21.398403 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: DEBUG nova.api.openstack.wsgi [None req-e62902ab-9555-4bff-8dee-2acec068b645 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] Calling method '.version_select at 0x7fafb726f790>' {{(pid=124895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 09:00:21.479223 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO nova.api.openstack.requestlog [None req-e62902ab-9555-4bff-8dee-2acec068b645 tempest-TestShelveInstance-1581464220 tempest-TestShelveInstance-1581464220-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1745644009" status: 202 len: 0 microversion: 2.1 time: 0.084623 Jul 18 09:00:21.479838 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: [pid: 124895|app: 0|req: 574/1151] 10.222.0.57 () {58 vars in 1253 bytes} [Mon Jul 18 09:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1745644009 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 09:01:23.674075 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 09:01:23.675129 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Mon Jul 18 09:01:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 09:01:28.783167 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Jul 18 09:03:23.241693 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 09:03:23.242350 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Mon Jul 18 09:03:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 09:03:49.751367 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 09:03:49.752066 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Mon Jul 18 09:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 09:03:58.786509 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 18 09:03:58.787276 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Mon Jul 18 09:03:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 09:04:14.643608 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 09:04:14.644274 dv-cinder-850142-3-iscsi devstack@n-api.service[124895]: Mon Jul 18 09:04:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 09:04:24.769794 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 09:04:24.770260 dv-cinder-850142-3-iscsi devstack@n-api.service[124894]: Mon Jul 18 09:04:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!